Data Engineer

Job Summary

We are looking for an experienced Data Engineer to build and optimize scalable data pipelines and AWS-based data platforms.

Key Responsibilities

Develop and maintain data pipelines using Python and PySpark.

Design and implement data lakehouse solutions on AWS.

Build and manage data workflows using AWS Glue, EMR, ECS, and Step Functions.

Work with DynamoDB and other data storage technologies.

Monitor data pipelines and ensure data quality, performance, and reliability.

Collaborate with stakeholders and engineering teams to deliver data solutions.

Mandatory Skills

5+ years of overall professional experience.

3+ years of experience in data platforms and big data technologies.

Strong proficiency in Python and PySpark.

Hands-on experience with AWS EMR, ECS, Glue, Step Functions, and DynamoDB.

Experience designing and implementing AWS data lakehouse architectures.

Good to Have

Apache Spark and Apache Iceberg.

AWS Lambda, EventBridge, Kinesis, and Redshift.

Experience with real-time data pipelines and event-driven architectures.