System Integration Consultants with Kafka Experience

Project overview

Ongoing search – we are building a pool of candidates for upcoming assignments throughout Denmark

We continuously match consultants to assignments as they come in – so you don't have to be available right now to be considered.

We are looking for system integration consultants with specific experience with Kafka in an Azure Cloud environment.

This requires a strong combination of understanding in:

The consultant must be able to design and implement a modern, event-driven streaming architecture.

As the migration environment is Azure, the consultant must be able to connect Kafka and the rest of the ecosystem in the cloud.

• Apache Kafka
• Kafka Core: Deep understanding of Topics, Partitions, Offsets, Consumer Groups, as well as Producers and Consumers.
• Kafka Connect: Experience using pre-built or custom-built source/sink connectors to integrate with external systems.
• Schema Registry: Experience with managing data contracts (data models), typically via Avro, Protobuf, or JSON Schema to ensure backward compatibility.
• Kafka Streams / KSQLDB: Competencies in real-time data processing, transformation, and enrichment of data directly within the stream.
• Azure Cloud Services (Infrastructure and Integration)
• Managed Kafka in Azure: Experience with either Azure Event Hubs (with Kafka surface/API) or Confluent Cloud on Azure.
• Azure Integration Services: Competencies in hybrid integration, including:
• Azure Logic Apps: For orchestration and visual workflows
• Azure Functions: For serverless, code-based transformation and microservices.
• Azure API Management (APIM): For exposing and securing APIs.
• Azure Service Bus: For traditional queue/topic-based message exchange, if pure streaming is not optimal.
• General Integration and Migration Competencies
• Programming: Strong skills in e.g., C# (.NET) or Java/Scala/Python (which are often used in Kafka ecosystems).
• Data Transformation: Experience converting old formats (XML/EDI) to modern formats (JSON/Avro).
• CI/CD and DevOps: Experience with automated deployment in Azure (e.g., via Azure DevOps or GitHub Actions) and Infrastructure as Code (Terraform or Bicep).
• Migration Strategies: Understanding of Phased Migration and Parallel Running.
• Security and Networking: Knowledge of Azure Key Vault, Managed Identities, VNet-peering, and Private Endpoints for securing data streams.

Project details

• Start: flexible
• Duration: > 12 months
• Remote: remote
• Location: Denmark, DK
• Languages: Danish