Senior Data Platform Engineer (Python) - Consultant
Join a team modernizing a large-scale cloud data platform for ingestion, processing, analytics, governance, and operational insight.
You will work across Python pipelines, Airflow orchestration, AWS lakehouse components, and the reliability and security needed in a regulated iGaming environment.
Responsibilities
- Build and maintain production Python data pipelines orchestrated with Airflow.
- Work across AWS data lake and warehouse components such as S3, Postgres/Redshift, Glue, and Lake Formation.
- Improve ingestion and transformation reliability, throughput, observability, and data quality.
- Apply CI/CD and Terraform to keep deployments repeatable and measurable.
- Contribute to lakehouse evolution with Spark, Kafka, Iceberg, and dbt.
- Enforce access control, schema validation, GDPR compliance, and PII governance.
- Mentor junior engineers and contribute to architecture and tooling decisions.
Requirements
- 5+ years building production Python data pipelines.
- Hands-on experience with AWS, Airflow, SQL, and data modeling.
- Practical Docker, Terraform, and CI/CD experience.
- Familiarity with Spark, Kafka, Iceberg, dbt, or similar lakehouse tooling.
- Strong focus on reliability, observability, and secure data handling.
- Experience in betting, gaming, fintech, or another regulated environment is a plus.
What will be your next steps?
Quick non-technical conversation
Our initial conversation is a brief, non-technical discussion to understand your background and career aspirations. We're keen to learn about your communication style and how you approach teamwork and decision-making.
60 to 90 minutes technical interview
This in-depth technical assessment, lasting 60 to 90 minutes, is designed to evaluate your specific skills and expertise. We will present you with challenges relevant to our client’s requirements.
Client interview
In this stage, you will meet directly with the client for a final technical discussion. This interview will be similar in format to our internal technical assessment, allowing the client to see firsthand how your expertise aligns with their specific project needs and team.
Offer
Congratulations on successfully completing our evaluation process. We are pleased to extend an offer and recommend you to our clients.
Apply for this role
Fill in your details below. We'll get back to you shortly.