Geforderte Skills
Jobbeschreibung
This contract role is for a Data Engineer (Azure) supporting data ingestion, transformation, aggregation, and pipeline quality work. The core stack named in the description includes Azure Synapse, PySpark, ADLS, SQL, CI/CD, and Databricks; Azure Synapse is explicitly marked mandatory. The work also includes backfills, freshness and completeness checks, corre
Project overview
This contract role is for a Data Engineer (Azure) supporting data ingestion, transformation, aggregation, and pipeline quality work. The core stack named in the description includes Azure Synapse, PySpark, ADLS, SQL, CI/CD, and Databricks; Azure Synapse is explicitly marked mandatory. The work also includes backfills, freshness and completeness checks, correctness and schema validation, reconciliation, refresh testing, documentation, runbooks, and knowledge transfer. The structured input indicates 2–5 years of experience and locations in Gurugram or Pune, but does not specify a work mode.
No separate nice-to-have skills or industry domain are stated.
Responsibilities
- Azure Synapse (Mandatory), PySpark, ADLS, Data Engineering, SQL, CI/CD, Databricks
- Implement Databricks ingestion, transformation and aggregation using PySpark/SQL.
- Execute backfill, data-quality checks (freshness, completeness, correctness, schema), reconciliation and refresh testing.
- Deliver code and pipeline documentation, operating runbooks and hands-on knowledge transfer.
Requirements
- Azure Synapse
- PySpark
- ADLS
- Data Engineering
- SQL
- CI/CD
- Databricks
Project details
- Start: flexible
- Remote: hybrid
- Location: India, IN
Indexiert von der 9am-Meta-Suche. Du bist Job-Anbieter? Listing beanspruchen oder verwalten
Gefunden auf ubique-systems.com