Required skills
- AWS
- SQL
- Python
- Spark
- PySpark
- AWS Glue Data Quality
- ETL
- Data Modeling
- Data Quality
- CI/CD
- Version Control
- Automated Testing
Languages: German
Job description
Seeking a Data Engineer with experience in AWS, SQL, and Python for a project in the transport and logistics sector. The role involves developing and automating data pipelines on an AWS cloud-native platform.
Project overview
Data Engineer (AWS, SQL, Python) 90% remote
For a project in transport and logistics, we are looking for a Data Engineer with experience in AWS, SQL, and Python.
Project Information
- Location: Frankfurt Main / 90% Remote
- Start: 01.01.2027
- Duration: 01.01.2027 – 31.12.2027
- Industry: Transport and Logistics
Responsibilities
Development, automation, and quality assurance of production-ready data pipelines in a cloud-native AWS data platform, as well as implementation of ETL/ELT pipelines and data models with SQL, Python, and Spark/PySpark, including AWS Managed Services, Data Quality, and CI/CD.
Must-Have Requirements
Should-Have Requirements
Technologies & Methods
AWS, SQL, Python, Spark, PySpark, Power BI, AWS Glue Data Quality, Docker, Data Exploration, Data Analysis, Data Modeling, Data Quality, Data Stewardship, Version Control, CI/CD, Automated Testing, Data Science, Product Owner, ETL, ELT, AWS Cloud Technologies, Managed Services, Cloud Data Platforms, Data Quality Rules
The mund consulting team looks forward to your application with CV & hourly rate and will gladly support you in the further process.
Best regards
The Recruiting Team
- Experience with Data Exploration, Data Analysis, Data Modeling, and Data Quality/Data Stewardship. (from 3 years)
- Experience in software development with version control, CI/CD, and automated testing. (from 3 years)
- Project experience with Power BI as a BI/Dashboard solution. (at least 1 reference)
- Relevant experience in development and automation of ETL pipelines and data modeling with SQL and Python, including at least 3 years with AWS cloud technologies and managed services for data pipelines. (from 5 years)
- Project experience with the AWS service AWS Glue Data Quality and the creation of Glue Data Quality rules. (at least 1 reference)
- Experience with serverless cloud data platforms or a comparable architecture to DB360 (at least 1 reference)
- Experience with established data science methods for forecasting, classification, or clustering. (at least 1 reference)
- Practical experience with Docker containers. (from 3 years)
- Experience with transport/logistics data and heterogeneous data sources, data formats, and quality requirements. (up to 3 years)
- Partial takeover of Product Owner tasks (requirements gathering and prioritization, formulation of user stories, backlog maintenance, or sprint planning) (at least 1 reference)
Project details
- Start: 2027-01
- Duration: 12 Monate
- Remote: hybrid
- Location: Frankfurt Main, Deutschland, DE
- Languages: German
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on FreelancerMap DE