Lead Data Engineer Python

Project overview

We are looking for a Lead Data Engineer Python to join a strategic mission within a large international group in the restaurant and services sector. You will lead the development of robust and scalable data solutions, combining deep technical expertise with team leadership.

This role is highly operational: you will directly contribute to the development of data pipelines, make structuring technical decisions, ensure code quality, and technically support your peers. You will work in an environment where rigor, performance, and innovation are at the heart of the challenges.

The project is part of a modernization effort for data and analytics infrastructure. You will be at the crossroads between business needs (ingestion, transformation, massive data processing) and the technical requirements of an enterprise data platform, applying best practices of Software Engineering and promoting solution scalability.

Responsibilities

Remote Work: Full remote work

Profile Sought

Essential:

Highly Appreciated:

Work Environment

DGTL / Signe + is the facilitator for all stakeholders seeking DATA resources or missions.

Specializing in the Data and BI market, we operate throughout France and internationally; through subcontracting, pre-employment, recruitment, commercial outsourcing, payroll outsourcing, etc.

Since 2018, we have been supporting our clients with proximity, fair pricing, and constant ethical consideration.

-masked link-

• Design, develop, and maintain robust and performant data pipelines in Python
• Manipulate, clean, transform, and enrich data with Pandas, NumPy, and DataFrames
• Develop reusable, maintainable, and testable Python components, adhering to Clean Code principles
• Define optimal technical solutions for data ingestion, transformation, and processing phases
• Ensure the quality, reliability, and performance of pipelines, particularly through data validation and data quality management
• Implement Software Engineering best practices: modularity, rigorous code review, unit and integration testing
• Analyze and resolve performance and scalability issues
• Assume technical leadership for your scope, drive architectural choices, and support junior Data Engineers
• Collaborate closely with Product Owners, Data Analysts, Data Scientists, and Engineering teams
• Proactively identify opportunities for optimization and automation of data processes
• Advanced Python level, with demonstrated mastery of data engineering (at least 5-6 years of production experience)
• Deep expertise in Pandas and NumPy, complex DataFrame manipulation
• Design and development of data pipelines, experience in large-scale data ingestion and transformation
• Solid SQL knowledge (complex queries, optimization, tuning)
• Unit tests and integration tests (relevant Python frameworks)
• Mastery of Clean Code, refactoring, and Software Engineering best practices (SOLID, DRY, etc.)
• Versioning (Git) and CI/CD practices, understanding of deployment workflows
• Data quality and data validation, methodical approach to managing data reliability
• Performance optimization and ability to diagnose and resolve bottlenecks
• Technical leadership capabilities: ownership, architectural decisions, constructive code reviews, mentoring
• Autonomy, rigor, and clear technical communication
• Databricks and distributed processing environments
• Microsoft Azure (Data Factory, Data Lake, DevOps)
• PySpark and Spark (massive data processing)
• Delta Lake and Lakehouse concepts
• DBT (data build tool) for data transformation
• Experience in Agile/Scrum environments and collaborative methodologies
• Sensitivity to data governance and enterprise scalability issues

Project details

• Start: ASAP
• Duration: 24 mois
• Remote: remote
• Location: Paris, France, FR
• Rate: 63-65 EUR/h
• Languages: French