Data Engineer(Databricks)

Project overview

This contract role focuses on building and supporting Databricks data integrations with Veeva and IQVIA systems. The core requirements are Databricks, API-based integration, PySpark and SQL development, and data ingestion, transformation, and aggregation. The work also includes backfills, data-quality checks, reconciliation, refresh testing, pipeline documentation, runbooks, and knowledge transfer; no additional nice-to-have skills are specified. The structured experience band is 3–6 years, with locations listed as Gurugram and Pune.

Work mode is not specified, and the description does not explicitly identify an industry or product team beyond these data-system integrations.

Responsibilities

• Databricks, Databricks- Veeva integration, databricks
• IQVIA integration
• Integrate databricks with Veeva/IQVIA data systems via API
• Implement Databricks ingestion, transformation and aggregation using PySpark/SQL.
• Execute backfill, data-quality checks (freshness, completeness, correctness, schema), reconciliation and refresh testing.
• Deliver code and pipeline documentation, operating runbooks and hands-on knowledge transfer.

Requirements

• Databricks
• Veeva data-system integration
• IQVIA data-system integration
• API-based data integration
• PySpark and SQL
• Data ingestion, transformation, and aggregation
• Backfill, data-quality checks, reconciliation, and refresh testing
• Pipeline documentation, operating runbooks, and knowledge transfer

Project details

• Start: flexible
• Remote: hybrid
• Location: India, IN