Required skills
- Python
- SQL
- dbt
- Data Pipeline Development
- Apache Airflow
- Git
- CI/CD
- REST APIs
- Dimensional Modeling
- Data Lakehouse Architecture
- Data Engineering
- Data Quality
Languages: French
Job description
Join an energy provider to build an internal, on-premise data platform using modern open-source tools. You will design, develop, industrialize, and maintain platform components, ensuring data acquisition, transformation, quality, and availability for analytics, business intelligence, and AI.
Project overview
For an energy provider, participate in the construction of an internal, on-premise Data platform, based on modern open-source tools.
You will design, develop, industrialize, and maintain the components of this platform. You will ensure the acquisition, transformation, quality, and availability of data necessary for analytical, decision-making, and artificial intelligence uses.
Design and development of flows
Modeling and valorization
Industrialization
Quality and governance
Operational maintenance
Technical environment
You will evolve within a technical community that fosters innovation, peer sharing, and skill development through training and certifications.
Profile sought
With a Master's degree (Bac+5) in computer science, you have 2 to 10 years of experience in Data Engineering, with proven experience on an industrial data platform in production.
Two profiles are sought, ideally one senior profile and one less experienced profile.
Essential skills
Appreciated skills
Expected qualities
- Design data flow architectures.
- Develop ingestion pipelines.
- Implement data transformations.
- Design analytical data models.
- Ensure indicator consistency.
- Maintain the technical components of the platform.
- Develop orchestration workflows.
- Participate in CI/CD deployments.
- Implement data quality controls.
- Contribute to the data catalog and ensure traceability.
- Monitor processes and analyze incidents.
- Contribute to platform evolutions.
- Document achievements and transfer knowledge.
- Development and querying: Python and SQL.
- Storage: SeaweedFS, S3 compatible.
- Ingestion: dlt.
- Transformation: dbt.
- Orchestration: Apache Airflow.
- Table format: DuckLake.
- Query engine: DuckDB.
- Data catalog: OpenMetadata.
- Authorization management: Keycloak.
- Version management: GitLab.
- Visualization: Power BI.
- Advanced proficiency in Python and SQL.
- Practical experience with dbt.
- Design and development of data pipelines.
- Process orchestration, with Airflow or equivalent tool.
- Proficiency in Git, CI/CD practices, and REST APIs.
- Business intelligence modeling, particularly star schema.
- Knowledge of Data Lake / Lakehouse architectures.
- Experience with an industrial data platform in production.
- Docker.
- Power BI.
- SAP: S/4HANA, CDS View, ODP, Datasphere or equivalent.
- Data governance and quality.
- MLOps and industrialization of Machine Learning models.
- Autonomy and rigor.
- Team spirit.
- Curiosity and proactivity.
Project details
- Start: ASAP
- Duration: 1 an
- Remote: hybrid
- Location: Grenoble, Auvergne-Rhône-Alpes, FR
- Languages: French
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on free-work.com