Data Engineer Python

Project overview

As part of a project to make data available for analysis, testing, or development purposes, you will contribute to designing and industrializing data preparation and anonymization processes. You will ensure their quality, traceability, and execution at scale.

The anonymization objectives and criteria are defined with the relevant stakeholders, including the DPO and the Compliance and Security teams. Pseudonymization should not be confused with anonymization.

Main missions

• Design, develop, and maintain data pipelines in Python.
• Process large volumes using Dask and Polars, evaluating their relevance according to use cases.
• Implement transformations defined within the project framework: deletion or transformation of fields, generalization, aggregation, or other selected techniques.
• Contribute to the detection of directly or indirectly identifying data, in coordination with the relevant experts.
• Develop automated controls: schema, quality, consistency, completeness, and regression detection.
• Measure processing performance and optimize resource consumption.
• Ensure the traceability of processes, code versions, and produced datasets.
• Document transformation rules, known limitations, and control results.
• Participate in code reviews, testing, and continuous integration.
• Collaborate with business, Data, Security, Compliance, and Data Protection teams.

Project details

• Start: flexible
• Remote: hybrid
• Location: Paris, France, FR
• Rate: 63-63 EUR/h
• Languages: French