Skip to content
Job boardOpen

Data Engineer GCP

P&P Solutions · Warszawa, Łucka, Poland · Hybrid · MID_LEVEL

  • Warszawa, Łucka, Poland · Hybrid
  • Polish · English

Indexed (today) · refreshed constantly

Budget
zł 100–130 / h
Start
flexible
Work mode
Hybrid
Contract
Freelance / B2B
Seniority
MID_LEVEL
Reference
p-p-solutions-data-engineer-gcp-warszawa-data

Required skills

Nice to have:ScalaCI/CDMetadata ManagementData Quality frameworksIBM MQAPI IntegrationSFTP Integration

Languages: Polish · English

Job description

We are looking for a Data Engineer with GCP experience to join a project migrating an Oracle data warehouse to Google Cloud Platform. You will be involved in developing data architecture, optimizing ETL processes, and building data pipelines for a Data Lake.

Project overview

We are looking for a Data Engineer (GCP).

You will join a project for one of the leading telecommunications operators. The team is responsible for migrating the existing Oracle-based data warehouse to the Google Cloud Platform (GCP) environment.

You will participate in the development of a modern data architecture, design and optimization of ETL processes, and building reliable data pipelines feeding the Data Lake environment.

  • Location: Warsaw / hybrid work (3 days a week from the office)
  • Cooperation model: B2B
  • Rate: up to PLN 130 net + VAT / hour
  • Level: Regular
  • Industry: Telecommunications

Responsibilities

We offer:

  • Design, build, and maintain data ingestion processes from various sources to the Data Lake.
  • Develop and optimize complex data pipelines.
  • Create and develop frameworks supporting the construction and maintenance of data processing processes.
  • Design and implement tests ensuring high quality and reliability of data pipelines.
  • Integrate data from various source systems, including Kafka, MQ, SFTP, databases, and APIs.
  • Cooperate with data analysts and Data Science teams.
  • Ensure the quality, security, consistency, and compliance of processed data.
  • Analyze and implement new technological solutions to improve the efficiency of data processes.
  • B2B cooperation.
  • Remuneration up to PLN 130 net + VAT per hour.
  • Hybrid work in Warsaw (3 days a week from the office) or the possibility of 100% remote work for people living outside Warsaw.
  • Work on migrating a data warehouse from Oracle to GCP and building data pipelines.
  • 14-day invoice payment term.
  • Support of a dedicated P&P Solutions account manager throughout the cooperation.
  • Private medical care.
  • Access to the MyBenefit cafeteria platform, allowing the use of, among others, MultiSport cards and prepaid cards for IKEA, Zalando, Notino, and many other brands.
  • Fast and transparent recruitment process.

Requirements

  • Minimum 3 years of experience in Data Engineering, Data Analytics, or Data Quality in an organization working with large datasets.
  • Practical knowledge of Google Cloud Platform (GCP) – a must.
  • Knowledge of dbt (Data Build Tool).
  • Very good knowledge of SQL and PL/SQL.
  • Good knowledge of Python.
  • Experience working with Linux and Bash scripts.
  • Knowledge of ETL processes and real-time data processing issues.
  • Practical knowledge of technologies from the Cloudera Hadoop ecosystem, particularly Apache Spark and Apache Kafka.
  • Knowledge of data quality and Data Governance issues.
  • Higher education in computer science, data analysis, statistics, economics, or related fields.
  • Knowledge of English at a minimum B2 level.

Nice to have

  • Knowledge of Scala.
  • Experience in building and maintaining CI/CD processes.
  • Knowledge of tools for automating software development and deployment processes.
  • Experience in metadata management and implementing Data Quality frameworks.
  • Experience in integrating data from various sources: Kafka, MQ, SFTP, API, databases, and file shares.

Project details

  • Start: flexible
  • Remote: hybrid
  • Location: Warszawa, Łucka, PL
  • Rate: 100-130 EUR/h
  • Languages: Polish, English

Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing

Found on justjoin.it

Browse all jobs
Sign up free to apply