Job description
Project overview
The Role: Technical Lead – Multi-tenant Data Integration Platform - GCP
Project details
Sheffield, UK
Position Type: Contract Inside IR35
Remote work option Available: 2-3 Days Onsite in a week
Job Description:
Required experience & skills
Desirable:
If this position is of interest to you, apply now!
- Proven experience as a Technical Lead / Lead Engineer delivering data engineering or integration platforms in cloud environments.
- Strong hands-on experience building production-grade ETL/ELT pipelines and orchestration with Apache Airflow.
- Solid experience on Google Cloud Platform, such as:
- Data services (e.g., BigQuery, Cloud Storage, Pub/Sub, Dataflow) and/or container platforms (e.g., GKE, Cloud Run)
- IAM, networking, secrets management, and environment separation
- Strong software engineering foundations: Python, APIs, configuration management, testing strategy, and performance tuning.
- CI/CD expertise (pipeline tooling, release controls, automated quality gates) and Infrastructure-as-Code experience (e.g., Terraform).
- Experience designing for reliability retries, idempotency, dead-letter patterns, backpressure handling, and operational resilience.
- Ability to translate complex technical topics for mixed audiences and drive alignment across teams.
- Experience implementing or integrating data lineage/metadata management tooling (e.g., Data Catalog-style metadata, OpenLineage, DataHub, etc.).
- Experience with multi-tenant platforms (tenant isolation models, metadata-driven frameworks).
- Knowledge of data governance concepts (data quality, auditability, retention, access controls).
- Experience integrating with external vendor systems and managing vendor technical dependencies.
- Start: flexible
- Remote: remote
- Location: Sheffield, GB
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on Vallum Associates