Required skills
Languages: French
Job description
Our client is looking for a Data Engineer specializing in data pipeline orchestration to join their Data platform modernization program. The mission involves migrating orchestration workflows from Azure Data Factory to Astronomer / Apache Airflow 3.
Project overview
Mission Context
As part of a Data platform modernization program, our client is looking for a Data Engineer specializing in data pipeline orchestration to strengthen their teams.
The mission is part of a project to migrate orchestration workflows currently managed under Azure Data Factory (ADF) to Astronomer / Apache Airflow 3.
Integrated into a Data Engineering team, you will provide operational support to the existing teams. Reporting to the Principal Data Engineer, you will actively participate in the migration, redesign, and optimization of data workflows and pipelines.
The position is strongly delivery-oriented, with close collaboration with the Data Engineers on the team.
Your main missions
- Design, develop, and maintain DAGs and data pipelines under Apache Airflow / Astronomer.
- Migrate and adapt existing orchestration workflows to the new platform.
- Modify and evolve data ingestion steps in Astronomer.
- Define and implement workflow scheduling and orchestration strategies.
- Adapt, if necessary, existing transformation flows under dbt.
- Perform technical and functional tests, validate developments, and contribute to their production deployment.
- Write technical documentation for the developments carried out.
- Identify and implement optimizations in terms of performance, cost, reliability, and maintainability.
- Ensure knowledge transfer to team members.
Project details
- Start: flexible
- Remote: hybrid
- Location: Paris, France, FR
- Languages: French
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on collective.work