Required skills
- Google Cloud Platform
- BigQuery
- Cloud Run
- Python
- SQL
- Google Cloud Storage
- REST API
- SFTP
- PostgreSQL
- Cloud SQL
- Data Architecture
- Cloud Native Architecture
Languages: French
Job description
Design and implement a GCP architecture for complex business process outsourcing, focusing on mass data processing with BigQuery and on-demand processing with Cloud Run.
Project overview
Context
As part of an interoperability project between an EPM SaaS solution and a Google Cloud Data platform, the client wishes to design and implement a GCP architecture to outsource complex business processes.
The mission involves carrying out two POCs:
Missions
Technical Environment
- Mass processing: ingestion and processing of large volumes of data via BigQuery, with processing cycles of 5 to 10 minutes.
- On-demand processing: development of low-latency calculation services via Cloud Run and Python.
- Design the target technical architecture on GCP.
- Implement data ingestion and transformation flows.
- Develop SQL processing on BigQuery and API services on Cloud Run.
- Integrate exchange flows via API, SFTP, and Google Cloud Storage.
- Work on performance, scalability, security, and reliability issues.
- Carry out POCs, measure performance, and optimize costs.
- Document the architecture and prepare for industrialization.
- Google Cloud Platform (GCP)
- BigQuery, Cloud Run, Cloud Storage
- Python, SQL
- REST API, SFTP
- PostgreSQL / Cloud SQL
- Data & Cloud Native Architecture
Project details
- Start: flexible
- Remote: hybrid
- Location: Paris, France, FR
- Languages: French
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on collective.work