Senior Data Engineer (Python, Databricks)
London
Hybrid (3/2 split)
6-month contract
£500 - £900 per day (via Umbrella)
cer Financial are working alongside an international bank who are looking for an experienced Senior Data Engineer to join their team on an initial 6-month contract. This is a hybrid role, requiring 3 days per week in the office.
Responsibilities:
- Design, build and optimise scalable data pipelines using Python and Databricks.
- Develop ETL/ELT workflows with Spark and Delta Lake.
- Build and maintain Lakehouse data models and architectures.
- Ensure data quality, governance and platform reliability.
- Optimise large-scale data processing and support analytics and ML initiatives.
- Mentor junior engineers and promote engineering best practices.
What the candidate needs:
- 10+ years' experience in Data Engineering.
- Strong Python and Databricks expertise, including Spark/PySpark and Delta Lake.
- Experience building scalable ETL pipelines and working with SQL.
- Knowledge of cloud platforms (AWS, Azure or GCP).
- Experience with modern data warehouses such as Snowflake, Redshift or BigQuery.
- Familiarity with Airflow or Databricks Workflows.
- Databricks certifications and experience with Kafka, Docker, Kubernetes or CI/CD are advantageous.