Senior LLM Solution Architect

Project overview

For an internationally active client, we are looking for an experienced Senior LLM Solution Architect (m/f/d) to conceptualize and introduce a company-wide LLM platform.

The goal of the project is to build a secure and controlled environment for the use of Large Language Models within the company. Company data from Microsoft and ERP systems are to be connected and made usable for selected use cases.

The focus is on data protection, access concepts, and security requirements, in addition to the technical architecture.

Responsibilities

RequirementsMust-have

• Development of a target architecture for the use of Large Language Models
• Consulting on the selection of suitable technologies and platforms
• Conception of the connection of Microsoft and ERP data sources
• Definition of security, role, and authorization concepts
• Assessment of risks regarding data protection, compliance, and information security
• Development of a scalable architecture for later productive use
• Conducting workshops with business departments and IT
• Experience in the field of Large Language Models (LLM)
• Experience in building or introducing internal AI or LLM platforms
• Experience with enterprise architectures
• Knowledge of data integration and API-based interfaces
• Experience with Microsoft environments
• Experience in connecting ERP systems
• Experience in stakeholder management

Nice to have

Soft Skills

• Azure OpenAI
• Microsoft AI Foundry
• Microsoft Copilot Studio
• SAP BTP
• RAG architectures (Retrieval Augmented Generation)
• Vector databases
• Kubernetes / Container platforms
• AI Governance
• Strong communication skills
• Hands-on mentality
• Experience in supporting change processes
• Structured and pragmatic way of working

Project details

• Start: ab sofort
• Duration: 5 Monate
• Remote: remote
• Location: Frankfurt, Deutschland, DE
• Languages: German