Senior Data Engineer, Data Migration, PostgreSQL, Cloud SQL, BigQuery, Google Cloud, Modernization

Project overview

For upcoming modernization projects in the mid-sized business sector, we are looking for experienced Data Engineers (m/f/d) for our expert pool.

A typical project looks like this:

Starting situation

A grown business application is being modernized and migrated to Google Cloud. The data is stored in a relational database (e.g., Oracle or Microsoft SQL Server) with a grown schema, stored procedures, and legacy data. The goal is cleaned data storage in Cloud SQL for PostgreSQL for the application, analyses in BigQuery, and an understandable, auditable data migration without operational interruption. Peripheral systems like an ERP (e.g., SAP) supply and receive data via defined interfaces.

Responsibilities

Must-haves

Desirable

Framework

Application

Please answer briefly:

For email communication, please include the project ID of this advertisement. Telephone contact only by prior appointment.

(Data Engineering, Data Migration, PostgreSQL, SQL, Oracle, Microsoft SQL Server, Google Cloud Platform, BigQuery, Dataflow, Python, ETL, Kafka)

• Analyze existing data model, data quality, and dependencies (schema, stored procedures, batch jobs, interfaces)
• Design target data model for PostgreSQL together with architects and backend developers and clean up legacy data
• Define migration strategy (step-by-step or in one go, Database Migration Service, Change Data Capture) and build migration scripts
• Perform data migration with reconciliation, validation rules, and acceptance reports, including test runs and rollback plan
• Build data pipelines for analyses (BigQuery, Dataflow, Pub/Sub or Kafka), batch and streaming
• Implement data protection and data security (pseudonymization of test data, authorizations, deletion concepts according to GDPR)
• Measure and optimize performance and costs of database and pipelines
• Document data flows and decisions and hand over to operations
• At least 5 years of experience as a Data Engineer or Database Developer, with at least 3 years using PostgreSQL or a comparable relational database in production applications
• At least one database migration between systems (e.g., Oracle or SQL Server to PostgreSQL) with reconciliation and acceptance, for which you were responsible
• Very good SQL, data modeling, and experience with schema changes during live operation (e.g., Flyway, Liquibase)
• Python or Java for migration and pipeline code, version control, and automated tests
• Fluent German, good English
• Google Cloud: Cloud SQL, BigQuery, Dataflow, Pub/Sub, Database Migration Service; Certification Google Professional Data Engineer
• Change Data Capture (e.g., Debezium) and Event Streaming (Kafka)
• dbt, Airflow or Cloud Composer, data catalog, and data governance
• Experience with ERP data (e.g., SAP extracts, OData)
• Infrastructure as Code (Terraform) and CI/CD for data pipelines
• Collaboration in agile, distributed teams
• Assignment: predominantly remote, occasional on-site appointments in DACH region
• Duration: typically 4 to 6 months, extension possible
• Utilization: 80 to 100 percent
• Start: project-dependent, from Q1 2027
• Which data migration have you significantly managed recently (source and target, data volume, your role, team size)?
• How do you ensure that no data record is lost or corrupted after the migration?
• What is your hourly rate and when are you available?

Project details

• Start: 2027-01
• Duration: 6 Monate
• Remote: hybrid
• Location: BerlinBrandenbug, Deutschland, DE
• Languages: German