Data Engineer BigQuery junior

Project overview

The Digital Factory Banque designs and develops digital banking services to offer a fluid, personalized, and integrated experience within the ecosystem of a major retail brand, with a focus on innovation, proximity, and simplicity.

As part of the modernization of the marketing and customer information system, the service aims to contribute to the construction of a unified data foundation.

Missions

Deliverables

Tools & Environment

• Migration & Ingestion: operate the transfer of customer repositories from legacy databases (Oracle) to the BigQuery environment on GCP.
• Pipeline Development: design and develop data ingestion flows via API and data transformations to consolidate a "Customer Vision 360" (multi-source data reconciliation).
• Industrialization: automate data processing and job orchestration using platform standards.
• Functional and documented data ingestion pipelines.
• Oracle to BigQuery migration scripts.
• Orchestration DAGs (Composer) deployed in production.
• Technical documentation of the Vision 360 data model.
• Master DBT for data transformation and orchestration.
• Work on Data and Cloud environments, particularly GCP.
• Exploit BigQuery and advanced SQL on large data volumes.
• Manipulate and analyze data in SQL.
• Use DBT to structure data pipelines.
• Manage real-time flows with Pub/Sub.
• Automate data workflows via GitLab CI/CD and Docker Compose.
• Work under Linux and on the command line.
• Version code with Git.
• Collaborate in an agile environment (Scrum).

Project details

• Start: flexible
• Remote: hybrid
• Location: 91300 Massy, France, FR
• Rate: 50-50 EUR/h
• Languages: French