Data and AI Platform (Transport & Logistics) – 4 Roles, Freelance Possible

Project overview

For the development and further enhancement of a data and AI platform for a group in the transport & logistics sector, we are looking for four freelancers. Basis: Microsoft Azure and Azure Databricks, containerized data/AI solutions, and on-prem AI infrastructure (Kubernetes/k3s). Goal: Further development of the Databricks platform, integration of existing AI components, migration of suitable solutions, scalable governance-compliant architecture.

Deployment at: Group in the transport & logistics sector

Responsibilities

Data pipelines on Azure Databricks (Python/SQL/PySpark/Delta Lake); Kubernetes ETL/Training/Inference; MLOps with MLflow; Automation via Terraform/GitLab CI/CD

Must-haves (mandatory, non-negotiable): RAG on Azure Databricks (2 Ref.); Streaming on Kubernetes+Databricks (2 Ref.); GitLab CI/CD+Tests+Deployments, Senior >5J; Railway operations/dispatch processes (1 Ref.); Python backend+SQL, Senior >5J

Advantageous: Databricks monitoring/Grafana, Medallion architectures/CDC, Migration experience, Studies in Physics/Mathematics

Role B – Senior Data Architect

Target/reference architecture of the platform; Databricks architecture (Workspace/Unity Catalog); Kubernetes/k3s architecture; MLOps conception; Governance/Security

Must-haves (mandatory, non-negotiable): Python+SQL, Senior >5J; Kubernetes/OpenShift on AWS (3 Ref.); Azure Databricks+MLOps including Governance (2 Ref.); Kafka streaming including application integration (2 Ref.); Railway operations including personnel dispatch (2 Ref.)

Advantageous: Databricks certification, Docker (Intermediate), GitOps/Grafana operation, Security by Design

Role C – Data Engineer

ETL pipelines on Databricks; containerized/Kubernetes workloads; On-prem GPU/CPU workloads; Deployment/Automation; Monitoring/Documentation

Must-haves (mandatory, non-negotiable): Kubernetes AWS+On-premise (Certificate CKA); Open-weight LLMs on-prem GPU (1 Ref.); Railway operations vehicle/connection dispatch/delay coding (1 Ref.); Infrastructure-as-Code, Intermediate >3J; MLflow+Azure Databricks (1 Ref.)

Advantageous: vLLM/OpenWebUI, internal railway operations, Explainable AI (SHAP/XGBoost)

Role D – Data Architect

Solution designs for Azure/Databricks/On-Prem; Databricks solution architecture; Migration analysis; Terraform/GitLab-CI/CD design; Technical evaluation

Must-haves (mandatory, non-negotiable): Certificate Databricks Certified Data Engineer Professional (required); Terraform/OpenTofu+GitLab-CI/CD for Databricks (2 Ref.); Kafka streaming on Databricks (1 Ref.); Tenant-capable Azure Databricks platforms, Intermediate >3J; Railway operations (2 Ref.)

Advantageous: Cross-cloud networking/pentests, dbt+MLflow, Azure Bicep, Grafana/Prometheus, Kubernetes (2 Ref.)

Project details

01.01.2027 – 31.12.2027

Scope: 110 PT per role

Contract type: Freelancers explicitly permitted.

Project language: German (mandatory)

Individual assignments per role possible.

Role A – Senior Data Scientist

• Start: 2027-01
• Duration: 12 Monate
• Remote: remote
• Location: Frankfurt am Main, Deutschland, DE
• Rate: 100-100 EUR/h
• Languages: German