Geforderte Skills
- Apache Airflow
- Big Data
- Google BigQuery
- Cloud-Engineering
- Data Architecture
- Data Governance
- ETL
- Data Migration
- Daten-Virtualisierung
- Datenbankentwicklung
- Python
- PostgreSQL
- Microsoft SQL Server Data Engine (MSDE)
- Datenbank-Engines
- Google Cloud
- Cloud Platform
- Google Data Studio
- Datenbank-Migration
- Apache Kafka
- Cloud-Migration
- Terraform
- Daten-Pipeline
Sprachen: English · German
Jobbeschreibung
Project overview
For upcoming modernization projects with mid-sized companies in the DACH region, we are looking for experienced Data Engineers (m/f/d) to join our expert pool. The work is 100% remote, and we welcome applications from anywhere in the world.
A typical project looks like this:
Starting point
An established business application is being modernized and migrated to Google Cloud. Its data sits in a relational database (e.g. Oracle or Microsoft SQL Server) with a grown schema, stored procedures and legacy baggage. The goal is a cleaned-up data layer in Cloud SQL for PostgreSQL for the application, analytics in BigQuery, and a traceable, verifiable data migration without service interruption. Surrounding systems such as an ERP (e.g. SAP) deliver and consume data through well-defined interfaces.
Responsibilities
- Analyze the existing data model, data quality and dependencies (schema, stored procedures, batch jobs, interfaces)
- Design the target data model for PostgreSQL together with architects and backend developers and clean up legacy structures
- Define the migration strategy (step by step or in one go, Database Migration Service, change data capture) and build the migration scripts
- Run the data migration with reconciliation, validation rules and acceptance reports, including trial runs and a rollback plan
- Build data pipelines for analytics (BigQuery, Dataflow, Pub/Sub or Kafka), batch and streaming
- Implement data protection and security (pseudonymized test data, permissions, GDPR deletion concepts)
- Measure and optimize performance and cost of database and pipelines
- Document data flows and decisions and hand over to operations
Requirements
- At least 5 years of experience as a data engineer or database developer, including at least 3 years with PostgreSQL or a comparable relational database in production applications
- At least one database migration between systems you were responsible for (e.g. Oracle or SQL Server to PostgreSQL), including reconciliation and acceptance
- Strong SQL, data modeling and experience with schema changes in running systems (e.g. Flyway, Liquibase)
- Python or Java for migration and pipeline code, version control and automated tests
- Fluent English
- At least 4 hours of daily overlap with Central European Time (CET)
Nice to have
Terms
Application
Please answer briefly:
In email communication please always include the project ID of this ad. Please do not call unless an appointment has been arranged.
(Data Engineering, Data Migration, PostgreSQL, SQL, Oracle, Microsoft SQL Server, Google Cloud Platform, BigQuery, Dataflow, Python, ETL, Kafka)
Job facts: Direct client project
- Google Cloud: Cloud SQL, BigQuery, Dataflow, Pub/Sub, Database Migration Service; Google Professional Data Engineer certification
- Change data capture (e.g. Debezium) and event streaming (Kafka)
- dbt, Airflow or Cloud Composer, data catalog and data governance
- Experience with ERP data (e.g. SAP extracts, OData)
- Infrastructure as code (Terraform) and CI/CD for data pipelines
- Experience working in agile, distributed teams
- German language skills
- Location: 100% remote
- Duration: typically 4 to 6 months, extension possible
- Workload: 80 to 100 percent
- Start: depending on the project, from Q1 2027
- Contract: freelance, invoicing in EUR
- Which data migration were you most recently responsible for (source and target, data volume, your role, team size)?
- How do you make sure that no record is missing or corrupted after the migration?
- What is your hourly rate in EUR, where are you based (country and time zone), and when are you available?
Project details
- Start: 2027-01
- Duration: 6 Monate
- Remote: remote
- Location: BerlinBrandenburg, Deutschland, DE
- Languages: English, German
Indexiert von der 9am-Meta-Suche. Du bist Job-Anbieter? Listing beanspruchen oder verwalten
Gefunden auf FreelancerMap DE