Required skills
- AWS
- AWS Glue Data Quality
- Power BI
- Python
- SQL
- PySpark
- Apache Spark
- ETL
- ELT
- Data Modeling
- Data Exploration
- Data Analysis
Languages: German
Job description
Experienced Data Engineer needed for a project in transport and logistics to develop and automate production-ready data pipelines in a cloud-native AWS environment.
Project overview
For a project in the transport and logistics sector, we are looking for an experienced Data Engineer to develop and automate production-ready data pipelines in a cloud-native AWS environment.
Your tasks include the conception, implementation, and quality assurance of ETL/ELT routes as well as the creation of data models using SQL, Python, and Spark/PySpark. You will work with AWS managed services, implement data quality processes, and establish CI/CD pipelines. Furthermore, you will partially support product owner tasks such as requirements gathering, prioritization, and backlog management.
We expect at least 5 years of experience in the development and automation of data pipelines, with at least 3 years using AWS cloud technologies and managed services. You should have sound knowledge in data exploration, data analysis, data modeling, and data stewardship, as well as experience with software development practices such as version control, CI/CD, and automated testing. Project experience with AWS Glue Data Quality and Power BI is required.
Experience with serverless cloud data platforms, data science methods (forecasting, classification, clustering), Docker containers, and knowledge of handling transport and logistics data are advantageous.
The project starts on 01/01/2027 and runs for 12 months. The work location is Frankfurt am Main with a 90% remote share. We look forward to your application with CV and hourly rate.
Project details
- Start: 01.01.2027
- Duration: 12 Monate
- Remote: hybrid
- Location: Frankfurt am Main, DE
- Languages: German
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on nexus.webconia.de