Required skills
- Databricks Certified Data Engineer Professional
- Azure Databricks
- Terraform
- OpenTofu
- GitLab CI/CD
- Apache Kafka
- Spark Structured Streaming
- Declarative Pipelines
- Data Architecture
- AI Infrastructure
- DevOps
- MLOps
Languages: German
Job description
Seeking a Senior Data Architect for a major project in the railway sector to design and implement modern data and AI platforms on Azure and on-premise infrastructure.
Project overview
Key Data at a Glance
Project Description & Tasks For a major project in the railway sector, we are looking for an experienced Senior Data Architect (m/f/d) for the conception and implementation of modern data and AI platforms. Your tasks include:
Important note for your application: It is imperative to ensure that the necessary required experience is shown in the profiles. Profiles from which the required knowledge and experience CANNOT be deduced unfortunately cannot be considered in the offer process.
Mandatory Requirements (Must-Have)
Desirable Knowledge (Nice-to-Have)
- Start: 01.01.2027
- Duration: until 31.12.2027
- Volume: 110 person-days (PD)
- Industry: Railway / Transport & Logistics
- Daily rate: €600.00 – €700.00 all-in
- Application deadline: by 15.11.2026 at 10 AM at the latest
- Creation of technical solution designs: Development of concrete solution designs based on specified target, reference, and platform architectures for Microsoft Azure, Azure Databricks, DBMC/DBCS, and on-premise AI infrastructures.
- Development of Databricks solutions: Conception of workspace, data flow, interface, catalog, schema, compute, and authorization structures in compliance with Unity Catalog and governance standards.
- Container & On-Premise Solutions: Design of technical solution designs for containerized data and AI components (DBMC/DBCS) as well as Kubernetes/k3s and GPU-based workloads on the on-premise AI infrastructure.
- Migration analysis & design: Analysis of existing data and AI solutions including dependencies, and creation of source-to-target mappings and migration designs.
- Data, MLOps & Integration Design: Conception of ETL/ELT, batch, streaming, training, and inference structures as well as platform interfaces.
- Automation & Deployment: Development of automated provisioning and deployment solutions using Terraform, Databricks Asset Bundles, GitLab CI/CD, Ansible, and GitOps.
- Governance & Evaluation: Translation of security, governance, and quality guidelines into technical designs, as well as prototype testing and documentation of new platform functions.
- Certification: Active certification as Databricks Certified Data Engineer Professional.
- Platform Architecture: At least 3 years of experience (Intermediate-Level) in architecture and implementation of multi-tenant Azure Databricks platforms (including workspace isolation, enterprise governance, and integration into DevOps/MLOps structures).
- Infrastructure as Code & CI/CD: Proven practical experience in developing parameterized Terraform/OpenTofu modules and GitLab CI/CD pipelines for automated provisioning and management of Databricks resources (min. 2 project references required).
- Streaming: Sound experience with Kafka-based streaming processing on Databricks using Spark Structured Streaming and Declarative Pipelines (min. 1 project reference required).
- Industry Experience: Proven project experience with data and AI applications in railway operations (min. 2 project references required).
- Kubernetes: Practical experience with Kubernetes (min. 2 project references).
- Databricks & MLOps Tooling: Experience with dbt, MLflow, and the development of reusable Databricks Asset Bundle templates with CLI scaffolding (min. 1 project reference).
- Cloud Security & Network: Experience with cross-cloud network configuration (Network Connectivity Configuration, Network Security Perimeter) as well as support for external penetration tests and implementation of security measures (min. 1 project reference).
- Azure IaC: Experience with Azure Bicep for infrastructure automation (min. 1 project reference).
- Observability & FinOps: Knowledge of monitoring and cost tools such as Grafana, Prometheus, and Azure Cost Monitor for Databricks and Kubernetes environments (min. 1 project reference).
Project details
- Start: 2027-01
- Duration: 12 Monate
- Remote: remote
- Location: Frankfurt, Deutschland, DE
- Rate: 75-88 EUR/h
- Languages: German
Indexed by 9am's meta-search. You are a job provider? Claim or manage this listing
Found on FreelancerMap DE