Senior Data Engineer – AWS Cloud & ETL

Job Summary

We are seeking a highly skilled and experienced Senior Data Engineer to join our growing team. This role will focus on designing, building, and maintaining robust data pipelines and infrastructure within an AWS Cloud environment. The ideal candidate will possess a strong understanding of ETL processes and a proven ability to deliver high-quality data solutions.

Key Responsibilities

While specific responsibilities will evolve with the needs of the business, the Senior Data Engineer will be expected to contribute to the following areas:

• Design, develop, and maintain ETL pipelines using AWS Glue and PySpark.
• Build and optimize data models and schemas for efficient data storage and retrieval.
• Implement and manage data security measures, including Data Masking and Access Control.
• Collaborate with cross-functional teams to understand data requirements and deliver effective solutions.

Required Skills & Qualifications

To be successful in this role, candidates must possess the following skills and qualifications:

• Education: A Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
• Experience: A minimum of 6-12 years of experience in data engineering, with a focus on building and maintaining data pipelines. This level of experience indicates a seasoned professional capable of independent work and mentoring junior team members.
• Cloud Computing: Extensive experience with AWS Cloud services, including Amazon S3, Redshift Spectrum, RDS, Lake Formation, and Amazon Kinesis.
• Data Processing & Storage: Proficiency in SQL and NoSQL databases.
• ETL Tools: Strong experience with AWS Glue and PySpark for data extraction, transformation, and loading.
• Data Security: Solid understanding of IAM principles and best practices for data security.
• Infrastructure as Code: Experience with CloudFormation and Terraform for managing infrastructure as code.
• Data Orchestration: Familiarity with AWS Step Functions and Event-driven Orchestration techniques.
• Version Control: Experience with CI/CD practices.
• Data Management: Knowledge of Delta Lake for efficient data versioning and management.
• Data Observability: Experience with Data Observability Platforms.

What We Offer

Salary: 25 LPA

This is a hybrid work mode position.