Senior PySpark Data Engineer – Big Data & Cloud Integration

Project overview

Unleash the power of data — transform experimental insights into scalable, high-performance workflows!

Kraków-based opportunity with hybrid work model.

As a Senior PySpark Data Engineer, you will be working for our client, a leader in large-scale data engineering and cloud integration. You will play a pivotal role in converting cutting-edge experimental code into robust, production-ready data pipelines, enabling innovative solutions across diverse projects. Join a dynamic environment where your expertise accelerates data-driven decision-making and fosters technological advancement.

Responsibilities

You're ideal for this role if you have:

• Convert experimental code into scalable, efficient workflows and modules.
• Develop and optimize data pipelines using PySpark and Spark on YARN.
• Collaborate with data scientists and engineers to productionize analytical solutions.
• Ensure code quality, perform performance tuning, and implement best data engineering practices.
• Maintain and improve performance of data workflows in a large-scale environment.
• Integrate data pipelines within cloud ecosystems, primarily Google Cloud Platform (GCP).
• Support continuous improvement through performance monitoring and optimization.
• 5+ years of experience in data engineering and PySpark/Spark development.
• Strong SQL skills and experience with Spark optimization techniques.
• Hands-on experience with the Hadoop ecosystem, especially Spark on YARN.
• Knowledge of cloud platforms, preferably GCP, is a strong plus.

Nice to have

Language required for the role:

Eligibility to work in Europe:

#MAKEYourCareerBETTER

Interested? Apply now and include your CV (preferably in English) along with a statement confirming your consent to the processing and storage of your personal data.

• Certifications or additional experience in cloud computing or big data solutions.
• English, with a communicative proficiency.
• Only candidates with an existing legal right to work in the European Union will be considered for this role.

Project details

• Start: flexible
• Remote: hybrid
• Location: Krakow, PL
• Rate: 26-500 EUR/h