Data Engineer – Python / Airflow / Azure Databricks

Project overview

Description

For a demanding data engineering project at an established company in Switzerland, we are looking for an experienced Data Engineer. The focus is on the further development of an existing on-premise data platform and the ongoing transformation into a modern Azure Databricks and Lakehouse architecture.

• Development and further development of Data Products
• Setup and maintenance of ingestion and transformation pipelines
• Ensuring data quality and performance
• Development and management of Apache Airflow DAGs
• Participation in architectural decisions regarding the Data Platform
• Support for the migration towards Azure Databricks
• Collaboration with Data Architect, DevOps Engineer, and Product Owner
• Support for internal users on data, platform, and Python topics

Requirements

• Several years of experience as a Data Engineer
• Very good knowledge of Python, especially pandas, polars, and Poetry
• Sound experience with Apache Airflow
• Very good SQL and PostgreSQL knowledge
• Experience with Azure Databricks
• Knowledge of Docker, Kubernetes, or OpenShift
• Experience with Azure DevOps / CI/CD
• Understanding of Data Mesh, Data Contracts, and Lakehouse architectures
• Ideally, experience with JupyterHub, Acryl DataHub, and MinIO S3
• Independent and proactive way of working with strong communication skills

Project details

• Start: 2026-10-01
• Duration: 3 Monate ++
• Location: Basel, CH
• Languages: German