Data Engineer

Project overview

Data Engineer – AWS / DataStage / Data Platforms

Your new company

You’ll be working with IBM on an urgent public-sector programme, supporting the delivery of enterprise-scale data platforms and solutions.

Your new role

As a Data Engineer, you’ll work across the data lifecycle, with a strong focus on data ingestion, transformation, migration, warehousing and data management.

You’ll be working with AWS data technologies alongside IBM DataStage, helping to build and maintain robust data integration and transformation processes across large-scale data environments.

Key responsibilities

What you'll need to succeed

You’ll need strong commercial data engineering experience, particularly across enterprise-scale ingestion, transformation, warehousing and database environments.

Essential skills and experience

What you need to do now

If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now.

If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion about your career.

#4840186 - Jade Connolly

• Rate: £520 per day
• Location: UK, Remote
• Working arrangement: Remote
• Residency requirement: Minimum 5 years’ continuous/unbroken UK residency – mandatory
• Design, develop and maintain enterprise-scale data ingestion and transformation processes.
• Develop and support ETL and data migration pipelines across both batch and real-time processing.
• Support the development and management of large-scale enterprise data warehouse solutions.
• Build and maintain data integration and transformation processes using IBM DataStage.
• Work with AWS technologies including Amazon Redshift, Amazon S3, AWS Glue and Amazon QuickSight.
• Develop and optimise SQL-based data transformations and work with relational databases.
• Support database storage, management and wider data-platform activities.
• Apply DevSecOps principles to data engineering and deployment processes.
• Use GitHub/GitLab for source control and collaborative engineering.
• Contribute to Java development where required within the wider data platform.
• IBM DataStage
• Amazon Redshift
• Amazon S3
• AWS Glue
• Amazon QuickSight
• AWS data/cloud environments
• ETL and data migration
• Batch and real-time data processing
• Enterprise data warehouse development
• Large-scale data ingestion and transformation
• SQL
• Relational databases
• Database / DBA knowledge
• DevSecOps
• Java
• GitHub / GitLab
• Minimum 5 years’ continuous/unbroken UK residency

Project details

• Start: flexible
• Remote: remote
• Location: Remote, GB