Required skills
- Microsoft Fabric
- Azure Synapse
- Apache PySpark
- T-SQL
- Azure SQL
- Microsoft Azure
- ETL
- Delta Lake
- Parquet
- Data Migration
- Medallion Architecture
- Stored Procedures
Languages: Polish · English
Job description
We are looking for a Data Engineer to plan and execute the migration of an entire environment from Azure Synapse to Microsoft Fabric. The project involves creating a Microsoft Fabric environment from architecture preparation to data implementation and final reporting.
Project overview
Hello! We are Angry Nerds and we invite you to our world of mobile and web apps!
A few words about Angry Nerds:
Software House | 10 years on the market | approx. 100 people on board | 545 projects completed
We are currently looking for a Data Engineer to plan and execute the migration of the entire environment from Azure Synapse to Microsoft Fabric. The project involves creating an environment in Microsoft Fabric, from preparing the architecture, through data implementation, to the final report. The client also places great importance on partnership and ongoing information exchange.
Responsibilities
We will provide you with:
Recruitment process:
Our expectations:
- Create code and collaborate with the project team and client,
- Analyze the performance of SQL and Pyspark queries,
- Optimize existing solutions,
- Participate in analyzing, estimating, and planning the project,
- Support other developers in analyzing and improving solutions,
- Propose new solutions and actively participate in improving existing ones,
- Communicate in English in daily work,
- Work with data of various formats and prepare it for further analysis using cloud technologies.
- Fully remote work
- Flexible working hours, good for early birds and night owls
- Company equipment and budget for accessories,
- Annual training budget,
- Co-financing for a sports package and medical care,
- Integration budget,
- Work in a company with a flat structure in a close-knit team of Nerds :)
- HR interview: approx. 40 min – we want to get to know you better!
- Technical verification via video call with our specialists: approx. 1.5 h,
- Client interview: approx. 1h,
- Decision and feedback on the recruitment process.
- Minimum several years of commercial experience in data processing using Microsoft Fabric cloud technologies,
- Knowledge of Azure Synapse
- Data Sets, Linked Services, Data Flow, Notebook, pipeline
- Experience in data migration projects from Azure Synapse to Microsoft Fabric.
- Good knowledge of Apache PySpark using Notebooks,
- Experience working with CSV, Delta, Parquet, JSON files
- Experience working with ETL, ELT pipelines,
- Experience working with Azure cloud,
- Experience working with Azure SQL,
- Very good knowledge of SQL (T-SQL),
- Analysis and maintenance of stored procedures, views,
- Identification and mapping of dependencies in a medallion architecture
- Reverse-engineering of business logic (output -> input), including documenting rules and identifying edge cases,
Project details
- Start: ASAP
- Remote: hybrid
- Location: Remote, Wrocław, PL
- Languages: Polish, English
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on nofluffjobs.com