Technical foundation for deploying Large Language Models and embedding models in our enterprise search and AI platform
Evaluation of new LLMs, embedding models and, prospectively, multimodal models (e.g., vision)
Qualitative and reproducible assessment of model quality in the context of real enterprise data (RAG scenarios)
Evaluation, integration and maintenance of LLM operational and inference components (e.g., vLLM, TEI, LangChain or comparable frameworks)
Maintenance and further development of the technical LLM platform (compatibility, stability, updates)
Development of internal tools and utilities for model, prompt and quality assessment
Prompt engineering and prompt tuning for different models and use cases
Evaluation and implementation of integration and interface concepts (e.g., MCP or similar standards)
Documentation, testing and internal technical support for other development and product teams

Enjoy developing and operating technical platforms in the AI / LLM / RAG domain
University degree in (business) computer science, mathematics, natural sciences or a comparable field
Practical experience with: Large Language Models and/or embedding models
Retrieval-Augmented Generation (RAG)
LLM frameworks, inference or serving components
Confident working knowledge of Python and experience developing robust software components
Good understanding of the quality, traceability and limitations of AI systems
Structured, independent and responsible working style
Excellent German and English skills, spoken and written (native German speaker or at least level C)

Careful and structured onboarding
Ongoing training and extensive development opportunities
Collaboration within an experienced, collegial team with high technical competence
Flexible working hours and excellent compatibility of work and family life
Flexible hours without core working hours
Option for up to 2 days of home office per week
Freedom to contribute your own ideas and take on responsibility
Regular team events & outdoor activities
Beverage flat (coffee, water and tea)
Good accessibility – our offices are well connected to DVB (bus & tram)
Job bike (Jobrad)
Training and development offerings

AI Platform Engineer – LLM, RAG

Key skills