Required skills
- SQL
- Python
- AWS Glue
- AWS Glue Data Quality
- AWS Lambda
- AWS Batch
- Airflow
- Power BI
- Git
- CI/CD
- Automated Testing
- ETL/ELT Pipelines
Languages: German
Job description
Experienced Data Engineer needed for a hybrid project focused on developing and optimizing data pipelines and applications within an AWS environment. The role involves building Power BI dashboards and implementing CI/CD processes.
Project overview
For a project in the Data & AI sector, we are looking for an experienced Data Engineer (m/f/d) to implement and further develop data pipelines and data applications in an AWS-based analysis environment.
The project is hybrid with a 90% remote share and starts on 01.01.2027 for a duration of 12 months. The work location is Frankfurt am Main.
Responsibilities
You will develop and optimize data pipelines and data applications using SQL, Python, AWS Glue, AWS Lambda, AWS Batch, and Airflow/MWAA. Further tasks include creating Power BI dashboards, working with Docker and Git, implementing CI/CD processes, testing, error analysis, and technical documentation.
Requirements
Technologies: AWS, Python, SQL, Git, CI/CD, Power BI, AWS Glue, Lambda, Batch, Airflow, MWAA, Docker, Data Science.
- Sound experience in software development with Git, CI/CD, and automated testing
- Project experience with Power BI as a BI and dashboard solution
- Proven experience with ETL/ELT pipelines and data modeling (SQL, Python, or comparable)
- Project experience with AWS cloud services for data processing and pipeline development
- Practical experience with AWS Glue Data Quality and the creation of corresponding rules
- Experience with serverless data platforms and orchestration solutions
- Knowledge in Data Science and established methods (forecasting, classification, clustering, anomaly detection)
- Experience with agile methods (Scrum, Kanban)
- Practical Docker experience
- Advantageous: Experience with data from transport and logistics
Project details
- Start: 01.01.2027
- Duration: 12 Monate
- Remote: hybrid
- Location: Frankfurt am Main, DE
- Languages: German
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on nexus.webconia.de