Required skills
Languages: French
Job description
As a Data Engineer, you will design, build, and maintain robust and performant infrastructures and pipelines, ensuring optimized and scalable data flow architecture and modeling. You will also guarantee code quality, rigorous documentation, and collaborate within an Agile Scrum environment.
Project overview
Context
As a Data Engineer within the team, you are a committed, dynamic, and proactive individual with a strong business acumen. You don't just maintain pipelines; you design them to generate value and accelerate innovation within our ecosystem. You will play a pivotal role in the success of new tool integration projects and the evolution of our systems.
Missions
Responsibilities
Tools & Environment
- Design, build, and maintain robust and performant infrastructures and pipelines
- Ensure an optimized and scalable architecture and data flow modeling
- Guarantee code quality and promote best practices
- Ensure clarity and sustainability of developments through rigorous documentation
- Provide expertise and help the team make the best technical choices
- Guarantee quality RUN (SLA) according to the "You build it, you run it" principle
- Ensure the quality, reliability, and governance of sales data
- Collaborate in an Agile (Scrum) environment
- Respect sprint commitments and engage in continuous improvement
- Data Core Platform (Cloud & Governance)
- Significant experience with DataBricks for cluster management, Big Data workload performance optimization, and establishing solid governance
- Knowledge of AWS will be a plus
- Languages & Modeling
- Advanced proficiency and practical experience with SQL for modeling and processing optimization
- Significant experience with DBT (Data Build Tool) for industrializing, documenting, and testing our data models
- Advanced proficiency and practical experience with Python for data transformation and processing
- Orchestration
- Significant experience with AirFlow / Astro for creating, monitoring, and optimizing complex DAGs (Directed Acyclic Graphs) ensuring the reliability of our Data production chain
- Methodology & Quality
- Work in an Agile (Scrum) environment
- Daily practice of code review and CI/CD (continuous integration and deployment) principles using tools like Git/GitLab/GitHub
- Ensure the quality of data (Our #1 promise from CdP) made available to our consumers
- Modeling
- Ensure modeling serves "Easy to Use" principles and usage performance
- Local International Communication
- Ensure effective and quality collaboration with our technical teams (Infra, OPS)
- Good knowledge of English is required, especially written, to interact daily with our country-based consumers and our non-French-speaking partners
Project details
- Start: flexible
- Remote: hybrid
- Location: Lille, France, FR
- Languages: French
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on collective.work