Required skills
- SQL
- Python
- ETL/ELT
- Data Modeling
- AWS
- PySpark
- AWS Glue Data Quality
- Power BI
- Data Quality Management
- Version Control
- CI/CD
- Automated Testing
Languages: German
Job description
We are looking for an experienced Senior AWS Data Engineer for a full-time project focused on cloud-native data technology. The role is remote with a location in Germany, involving approximately 200 project days, with 12 days on-site.
Project overview
We are looking for an experienced Senior AWS Data Engineer for a full-time project in cloud-native data technology. The position is remote with a location in Germany and comprises approximately 200 project days, 12 of which are on-site.
In this role, you will develop and automate production-ready data pipelines on an AWS-based data platform. You will be responsible for developing ETL/ELT pipelines and data models using SQL, Python, and Spark/PySpark. You will utilize AWS managed services for data ingestion, transformation, orchestration, and provisioning. A further focus is on ensuring data quality and providing analyzable data for dashboards and data science use cases.
You will work in an agile team and implement modern software development and CI/CD practices.
Requirements
Experience with serverless cloud data platforms, data science methods, Docker containers, as well as knowledge of transport/logistics data is desirable. Product owner tasks can be partially taken over.
- At least 5 years of experience in ETL development and data modeling with SQL and Python, with at least 3 years using AWS cloud technologies
- At least 3 years of experience in data exploration, data analysis, and data quality management
- At least 3 years of experience in software development with version control, CI/CD, and automated testing
- Project experience with Power BI and AWS Glue Data Quality
Project details
- Start: 01.01.2027
- Duration: 01.01.2027 - 31.12.2027
- Remote: hybrid
- Location: Frankfurt am Main, DE
- Languages: German
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on nexus.webconia.de