Data Engineer (OpenAPI | Azure | Python)

Project overview

We are looking for an experienced Data Engineer / Data Architect to join our team and help us build and optimize data pipelines, process large text datasets, and integrate them via OpenAPI.

Note: We are looking for a specialist in Data Engineering / Data Architecture, not a Python Full Stack Developer.

---

Engagement Conditions:

Area: IT Consulting

Requirements

• Python – very good knowledge of the language and ability to write efficient, clean code focused on data processing and analysis.
• Azure Cloud – practical, commercial experience working with key data services in the Microsoft Azure environment.
• OpenAPI / REST API – practical knowledge of the OpenAPI (Swagger) standard in the context of data pipeline integration, providing endpoints, and documenting API specifications.
• Knowledge bases – experience in designing, maintaining, or integrating knowledge bases, vector databases, and advanced data storage structures.
• Large volumes of text data – experience working with large text files (read/write optimization, efficient processing).
• Communication / English Language – highly developed interpersonal skills and fluent communication in English in daily project work.

Nice to have

We Offer

• Experience with data orchestration and CI/CD tools in Azure (e.g., Azure Data Factory, Azure DevOps).
• Experience in integrating pipelines with LLM / RAG models.
• Stable B2B cooperation with the prospect of a long-term relationship
• Development within the structures of a mature organization with a well-established reputation and strong market position
• Complete workstation: we provide modern, personalized equipment and a full software package ready to go
• Full flexibility and balance: you work 100% remotely, and you start your day as you like – flexible start between 6:00 and 10:00
• Dedicated mentoring: constant care and partnership support in shaping your career path from the 1dea expert team
• We focus on relationships – we build a culture based on mutual respect, teamwork, and knowledge sharing
• Real impact on projects: there are no rigid schemes here. You have full space to submit your own initiatives, and your ideas shape our solutions

Project details

100% remote

Business trips: no

ASAP (we accept applications with max 1 month availability for start)

Rate (individually set): 150 - 160 PLN net + VAT / h

Engagement: B2B (outsourcing with 1dea), full-time, long-term (12 months+)

Scope of Responsibilities

• Short introductory phone call with a 1dea recruiter (~10 min)
• Technical and project verification with the Client (~1 – 1.5 h)
• Introductory meeting with a representative of the project at the end client (~30 min)
• Decision to cooperate
• Building, optimizing, and maintaining efficient data pipelines in the Azure cloud
• Processing, parsing, cleaning, and structuring large volumes of text data
• Developing and maintaining knowledge bases (including vector databases / data storage structures) for analytical purposes and AI/ML solutions
• Designing, integrating, and providing APIs in OpenAPI (Swagger) standard for feeding and exposing data from pipelines to other systems
• Creating consistent documentation of data contracts and touchpoints (API-first) in OpenAPI standard
• Cooperating with the team of analysts, architects, and engineers in designing a comprehensive data architecture
• Start: flexible
• Remote: remote
• Location: Warszawa, Flory 9, PL
• Rate: 150-160 EUR/h
• Languages: Polish, English