Required skills
- Python
- Data Quality
- Data Usability
- Machine Learning
- Data Pipelines
- Distributed Data Processing
- Real-time Data Processing
- Spark
- Database Management Systems
- Cloud Storage
- Architecture Patterns
- Data Analysis
- Software Testing
- Security
- Data Protection
- Workflow Scheduling
- Apache Airflow
- Monitoring Tools
- Apache NiFi
Languages: German · English · Croatian · Bosnian · Serbian
Job description
We are looking for a Data Engineer to join our team, focusing on improving data quality and usability, implementing machine learning algorithms, and building/optimizing data pipelines.
Project overview
We are looking for a Data Engineer to strengthen our data engineering team, which focuses on improving data quality and usability, implementing machine learning algorithms, and creating and optimizing data pipelines.
Further Framework Data
Type of Assignment:
Utilization: 100%
Industry:
Responsibilities
Must-Have Requirements
Nice-to-Have Requirements
Further Information
The position is remote with reference to Zagreb and requires occasional on-site presence for PI planning.
- Maintain and improve the quality, reliability, and usability of data
- Design, implement, and optimize data pipelines, including workflows for distributed and real-time data processing
- Implement machine learning algorithms in data workflows
- Develop and maintain processes for pipeline testing, deployment, scheduling, and monitoring
- Apply appropriate architectural, security, and data protection patterns to data pipelines and analysis workflows
- Excellent knowledge of Python
- Basic understanding of other technology stacks and ability to identify problems with other technologies
- In-depth knowledge of at least one distributed computing framework such as Spark
- In-depth knowledge of at least one database management system and query language
- In-depth understanding of cloud-based storage solutions
- Good knowledge of architectural patterns
- Good understanding of data analysis techniques
- Ability to set up data delivery pipelines
- Experience in writing tests
- Good knowledge of security and data protection best practices
- Good knowledge of at least one workflow scheduling tool such as Apache Airflow
- Knowledge in implementing monitoring tools
- Experience with NiFi
- Experience in real-time data processing
- Ability to work in English
- Knowledge of Croatian, Bosnian, Serbian, or Montenegrin
Project details
- Start: 2027-01-01
- Duration: Nicht bekannt
- Remote: onsite
- Location: Zagreb, Deutschland, DE
- Languages: German, English, Croatian, Bosnian, Serbian
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on FreelancerMap DE