AWS Data engineer

Job Title: AWS Data Engineer

Experience: 7–9 Years Location: Bangalore  Hyderabad Employment Type: Full-Time

Job Summary

We are looking for an experienced AWS Data Engineer with 7–9 years of hands-on experience in designing, developing, and maintaining scalable cloud-based data platforms on AWS. The ideal candidate should have strong expertise in data engineering, ETL/ELT pipelines, data warehousing, and big data technologies, along with proficiency in Python and SQL.

Key Responsibilities

• Design, build, and maintain scalable data pipelines on AWS.
• Develop ETL/ELT workflows using AWS services such as Glue, Lambda, Step Functions, EMR, and Redshift.
• Ingest structured and unstructured data from multiple sources into data lakes and data warehouses.
• Implement data transformation, cleansing, validation, and aggregation processes.
• Optimize data processing jobs for performance, scalability, and cost efficiency.
• Work with data scientists, analysts, and business stakeholders to deliver reliable data solutions.
• Ensure data quality, governance, security, and compliance standards are followed.
• Automate deployment and monitoring of data pipelines using CI/CD and infrastructure-as-code practices.
• Troubleshoot production data issues and provide timely resolutions.

Required Skills

• Strong experience with AWS data services:
  • S3
  • Glue
  • Redshift
  • Lambda
  • EMR
  • Athena
  • Step Functions
  • IAM
  • CloudWatch
• Strong programming skills in Python.
• Advanced SQL skills and experience with relational databases.
• Hands-on experience with Spark / PySpark and big data processing.
• Experience in building data lakes and data warehouse solutions.
• Knowledge of data modeling concepts (star schema, snowflake schema, dimensional modeling).
• Experience with workflow orchestration tools such as Airflow or AWS Step Functions.
• Understanding of DevOps practices, Git, and CI/CD pipelines.

Preferred Skills

• Experience with Databricks, Kafka, or streaming technologies.
• Exposure to Terraform or CloudFormation.
• Experience with data governance and catalog tools.
• AWS certifications such as AWS Certified Data Engineer – Associate or AWS Certified Solutions Architect are preferred.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.
• 7–9 years of overall IT experience with significant hands-on experience in AWS data engineering.

Good to Have

• Exposure to AI/ML data pipelines.
• Experience working in Agile/Scrum teams.
• Strong communication and stakeholder management skills.