Senior Data Engineer
We are looking for a Senior Data Engineer to design, build, and optimize scalable data pipelines and infrastructure. The ideal candidate will have deep expertise in AWS, Snowflake, Terraform, and strong programming skills in SQL, Python, and PySpark. You will play a key role in collaborating with Data tech lead/lead data engineer while managing data workflows, ensuring data reliability, and implementing best practices for data governance and observability. This work will directly empower data-driven products, personalization, reporting, data science, machine learning, and our overall business success.
Requirements
- Strong collaboration and communication skills
- Strong proficiency in SQL, Python, and PySpark for data processing and transformation
- Hands-on experience with AWS
- Expertise in Snowflake (performance tuning, Snowflake SQL, schema design)
- Expertise with Terraform for infrastructure automation
- Proficiency in Airflow or other orchestration tools
- Understanding of data observability, monitoring, and governance best practices
- Experience with version control (Git) and CI/CD for data pipelines
- Strong problem-solving skills and ability to work independently in a fast-paced environment
- Experience with any code base ETL/ELT tools
Responsibilities
- Developing reusable custom frameworks using cloud technologies like AWS, Snowflake and Managed Airflow
- Design and develop scalable ETL/ELT pipelines using Python, SQL, and PySpark
- Implement infrastructure-as-code (IaC) using Terraform for cloud-based data environments
- Develop and maintain data models, transformations, and orchestration workflows
- Ensure data quality, observability, and lineage tracking across the ecosystem
- Optimize query performance, storage costs, and compute resources in Snowflake and AWS
- Implement CI/CD pipelines for data infrastructure automation
- Monitor and troubleshoot data pipelines, jobs, and cloud infrastructure to maintain SLAs
Senior Data Engineer
What will be your next steps?
Quick non-technical conversation
Our initial conversation is a brief, non-technical discussion to understand your background and career aspirations. We're keen to learn about your communication style and how you approach teamwork and decision-making.
60 to 90 minutes technical interview
This in-depth technical assessment, lasting 60 to 90 minutes, is designed to evaluate your specific skills and expertise. We will present you with challenges relevant to our client's requirements.
Client interview
In this stage, you will meet directly with the client for a final technical discussion. This interview will be similar in format to our internal technical assessment, allowing the client to see firsthand how your expertise aligns with their specific project needs and team.
Offer
Congratulations on successfully completing our rigorous evaluation process. We are pleased to extend an offer and recommend you to our clients.