Required skills
- Data Engineering
- Big Data
- Data Lake
- SQL
- Python
- ETL
- Data Ingestion
- Data Transformation
- Data Pipelines
- Data Modeling
- Control-M
- Batch Processing
- Data Validation
- Data Reconciliation
Languages: English · Polish
Job description
Seeking a Big Data Developer for a project with an international banking organization, focusing on data management and processing. The role involves developing and maintaining data pipelines, ETL processes, and data models.
Project overview
Scope of cooperation includes:
Competencies required for service delivery:
- participation in a project for an international organization in the banking sector, in the area of data management and processing,
- analysis of existing data models, flows, transformations, and dependencies in the Data Lake environment,
- development and maintenance of Python, ETL processes, and data pipelines,
- implementation of data ingestion, transformation, and processing mechanisms,
- development and maintenance of Control-M tasks and batch processes,
- creation and adaptation of data models and datasets for the Limits area solution,
- data analysis using SQL, validation, and reconciliation of data between different sources,
- implementation of data quality control mechanisms and support in solving data-related problems,
- participation in tests, certification, implementations, and production releases,
- preparation and maintenance of technical documentation regarding data models, processes, and transformations,
- hybrid cooperation model from Warsaw,
- rate up to 145 PLN/h + VAT (B2B).
- minimum 2 years of experience in Data Engineering / Big Data,
- practical knowledge of Big Data and Data Lake environments,
- very good knowledge of SQL,
- experience in Python programming,
- practical experience in creating ETL processes,
- experience in data ingestion and transformation,
- knowledge of building and maintaining data pipelines,
- experience in data modeling,
- knowledge of Control-M and batch processes,
- ability to analyze, validate, and reconcile data,
- knowledge of English at a minimum B2 level,
- knowledge of Atoti / ActiveViam is welcome,
- experience with Databricks is welcome,
- knowledge of REST API and microservices architecture will be an additional advantage,
- knowledge of Jira and Confluence is welcome,
- experience in Counterparty Risk / Limits will be an additional advantage.
Project details
- Start: flexible
- Remote: hybrid
- Location: Warszawa, centrum, PL
- Rate: 120-145 EUR/h
- Languages: English, Polish
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on justjoin.it