Geforderte Skills
- Data Engineering
- Data Analytics
- Data Quality
- Google Cloud Platform (GCP)
- dbt
- SQL
- PL/SQL
- Python
- Linux
- Bash
- ETL
- Apache Spark
- Apache Kafka
- Cloudera Hadoop
- Data Governance
- English B2
Sprachen: Polish · English
Jobbeschreibung
We are looking for a Data Engineer with GCP experience to join a project migrating an Oracle data warehouse to Google Cloud Platform. You will be involved in developing data architecture, optimizing ETL processes, and building data pipelines for a Data Lake.
Project overview
We are looking for a Data Engineer (GCP).
You will join a project for one of the leading telecommunications operators. The team is responsible for migrating the existing Oracle-based data warehouse to the Google Cloud Platform (GCP) environment.
You will participate in the development of a modern data architecture, design and optimization of ETL processes, and building reliable data pipelines feeding the Data Lake environment.
- Location: Warsaw / hybrid work (3 days a week from the office)
- Cooperation model: B2B
- Rate: up to PLN 130 net + VAT / hour
- Level: Regular
- Industry: Telecommunications
Responsibilities
We offer:
- Design, build, and maintain data ingestion processes from various sources to the Data Lake.
- Develop and optimize complex data pipelines.
- Create and develop frameworks supporting the construction and maintenance of data processing processes.
- Design and implement tests ensuring high quality and reliability of data pipelines.
- Integrate data from various source systems, including Kafka, MQ, SFTP, databases, and APIs.
- Cooperate with data analysts and Data Science teams.
- Ensure the quality, security, consistency, and compliance of processed data.
- Analyze and implement new technological solutions to improve the efficiency of data processes.
- B2B cooperation.
- Remuneration up to PLN 130 net + VAT per hour.
- Hybrid work in Warsaw (3 days a week from the office) or the possibility of 100% remote work for people living outside Warsaw.
- Work on migrating a data warehouse from Oracle to GCP and building data pipelines.
- 14-day invoice payment term.
- Support of a dedicated P&P Solutions account manager throughout the cooperation.
- Private medical care.
- Access to the MyBenefit cafeteria platform, allowing the use of, among others, MultiSport cards and prepaid cards for IKEA, Zalando, Notino, and many other brands.
- Fast and transparent recruitment process.
Requirements
- Minimum 3 years of experience in Data Engineering, Data Analytics, or Data Quality in an organization working with large datasets.
- Practical knowledge of Google Cloud Platform (GCP) – a must.
- Knowledge of dbt (Data Build Tool).
- Very good knowledge of SQL and PL/SQL.
- Good knowledge of Python.
- Experience working with Linux and Bash scripts.
- Knowledge of ETL processes and real-time data processing issues.
- Practical knowledge of technologies from the Cloudera Hadoop ecosystem, particularly Apache Spark and Apache Kafka.
- Knowledge of data quality and Data Governance issues.
- Higher education in computer science, data analysis, statistics, economics, or related fields.
- Knowledge of English at a minimum B2 level.
Nice to have
- Knowledge of Scala.
- Experience in building and maintaining CI/CD processes.
- Knowledge of tools for automating software development and deployment processes.
- Experience in metadata management and implementing Data Quality frameworks.
- Experience in integrating data from various sources: Kafka, MQ, SFTP, API, databases, and file shares.
Project details
- Start: flexible
- Remote: hybrid
- Location: Warszawa, Łucka, PL
- Rate: 100-130 EUR/h
- Languages: Polish, English
Indexiert von der 9am-Meta-Suche. Du bist Job-Anbieter? Listing beanspruchen oder verwalten
Gefunden auf justjoin.it