Skip to content
JobServeOpen

AWS Data Engineer

Intuition IT Solutions Ltd · Watford, UK · Hybrid · Senior

  • Watford, UK · Hybrid
  • English

Indexed (yesterday) · refreshed constantly

Start
flexible
Work mode
Hybrid
Contract
Freelance / B2B
Seniority
Senior
Reference
492662364-1

Required skills

Languages: English

Job description

Project overview

Job Title - AWS Data Engineer

Project details

Coventry UK (Hybrid)

Employment Type: Contract.

Detailed Job Description:

Role:

Configure Databricks Auto Loader or Apache Spark Structured Streaming to securely subscribe to the relevant SAP AEM topics.

Develop the PySpark/SQL data pipelines to process the incoming JSON payloads through the Delta Lake layers.

Carry out data modelling in Databricks.

Expose the Delta tables to the visualisation layer.

Ensure that the data pipelines are optimised.

Skillsets:

Expert in Apache Spark Structured Streaming and Databricks Auto Loader.

Fluent in PySpark and Databricks SQL.

Proven experience building Databricks architecture patterns.

Familiarity with Unity Catalog for data governance and access control.

  • Start: flexible
  • Remote: hybrid
  • Location: Watford, UK, GB
  • Languages: English

Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing

Found on JobServe

  1. Job boardNew

    AWS Data Engineer

    Confidential· India· On-site· Senior

    • AWS
    • Amazon S3
    • AWS Glue
    • +9

Browse all jobs
Sign up free to apply