Required skills
- Databricks
- Azure
- Lakehouse Architecture
- Delta Lake
- Unity Catalog
- DLT/SDP
- Python
- PySpark
- SQL
- Data Modeling
- Data Quality
- Data Governance
Languages: German
Job description
Seeking a Senior Databricks Engineer for a DWH migration project to an Azure/Databricks Lakehouse architecture. The role involves migrating existing ETL processes and collaborating within a Scrum team.
Project overview
For our client, we are filling the position on a freelance basis for a
Senior Databricks Engineer – DWH Migration
Responsibilities
- Migration of an existing Oracle/Informatica Data Warehouse into a modern Azure/Databricks Lakehouse architecture.
- Transfer of existing ETL processes into robust, scalable, and performant Databricks data pipelines.
- Implementation and further development of data models, data quality, historization, and authorization and governance concepts.
- Execution and support of tests, parallel operation, and cutover.
- Close collaboration with business departments and other Data Engineers within a Scrum team.
Requirements
What the client is looking for between the lines:
An experienced, operationally strong Data Engineer who understands classic DWH structures and can independently transfer them into a productive Databricks solution.
Someone who, in addition to development, also keeps an eye on data quality, operational reliability, and a smooth transition from the old to the target system.
We look forward to your application!
- Sound practical experience with Microsoft Azure, Databricks, and Lakehouse architectures, as well as in the setup and operation of Databricks.
- Deep knowledge of Delta Lake, Unity Catalog, and DLT/SDP, as well as authorization models and data governance.
- Very good knowledge of Python, PySpark, and SQL, including performance optimization for large data volumes, and confident use of AI-supported development tools.
- Sound DWH/BI experience in data storage, data modeling, data transport, and SCD2 historization; ideally experience with ETL migrations to Databricks, as well as Oracle and Informatica.
- Experience as a developer in a Scrum team, excellent German language skills (written and spoken), and confident communication with business departments and development teams.
Project details
ASAP
Until the end of 2027
Utilization: 100%
Hybrid (Greater Cologne area and Remote) 2 days per week on-site; ideally from NRW
- Start: ab sofort
- Duration: 14 Monate
- Remote: hybrid
- Location: hürth, Deutschland, DE
- Languages: German
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on FreelancerMap DE