Software Engineer - Full Stack AI

Boehringer Ingelheim is a global leader in healthcare, and they are seeking a Software Engineer - Full Stack AI to design, build, and integrate AI-powered solutions into applications. The role involves collaborating with product and engineering teams to develop and implement AI features, maintain existing systems, and stay current with AI/ML advancements.

Responsibilities:

• AI Integration & Development: Design and implement LLM-based features and pipelines using frameworks such as LangChain and LangGraph. Build and maintain Retrieval-Augmented Generation (RAG) systems, including vector store management, chunking strategies, embedding pipelines, and retrieval optimization
• Prototyping & Experimentation: Rapidly explore and evaluate new AI capabilities, tools, and approaches. Translate ambiguous problem statements into working prototypes that demonstrate value and inform product direction
• Collaboration & Requirements Gathering: Meet regularly with IT colleagues, product owners, and stakeholders to understand business needs and translate them into well-scoped AI engineering solutions. Communicate tradeoffs clearly across technical and non-technical audiences
• Application Support: Maintain and improve existing AI-integrated systems, troubleshoot pipeline failures, and take corrective action on issues related to retrieval quality, prompt behavior, or model outputs
• Project Participation: Contribute to project teams by delivering on assigned tasks and action items, participating in agile ceremonies, and supporting delivery against team goals
• Technical Awareness: Stay current with the rapidly evolving AI/ML landscape, including emerging LLM capabilities, new tooling, and best practices for responsible AI development
• Documentation: Produce clear documentation for AI workflows, integration patterns, prompt templates, and system architecture in support of both operational and project activities

Requirements:

• Proficiency in Python for AI/ML development and backend service integration
• Hands-on experience with LangChain and/or LangGraph for building agentic and multi-step LLM workflows
• Strong understanding of RAG pipelines end-to-end: document ingestion, chunking, embedding, vector storage, and query-time retrieval
• Familiarity with leading LLM providers and APIs (e.g., OpenAI, Anthropic, Azure OpenAI, AWS Bedrock)
• Experience with evaluation and testing of AI systems, including retrieval quality metrics, LLM output assessment, and regression testing for prompt changes
• Understanding of AI observability and experimentation tooling (e.g., LangSmith, Weights & Biases, or equivalent)
• Working knowledge of vector databases and semantic search principles
• Solid foundation in software engineering practices: version control (Git), CI/CD, and containerization (Docker)
• Effective communication skills with the ability to explain AI system behavior and limitations to non-technical stakeholders
• Associate degree in Computer Science or MIS with a minimum of 4 years experience; or Bachelor degree in Computer Science, or MIS, or related field with a minimum of 2 years of experience; or a Master degree in Computer Science, MIS, with minimum 1 year of experience; or relevant Business or IT experience of minimum of 4 years
• Hands-on experience building and shipping software in Python, with working knowledge of REST API development and integration patterns
• Demonstrated experience integrating LLMs into applications using frameworks such as LangChain, LangGraph, or equivalent
• Practical understanding of RAG architectures, including embedding models, vector databases (e.g., FAISS, Chroma, Pinecone, Weaviate), and retrieval strategies
• Familiarity with prompt engineering techniques, including few-shot prompting, chain-of-thought, and system prompt design
• Knowledge of software development lifecycle and experience working on agile project teams
• Associate degree in Computer Science, MIS or a related field with a minimum of 7 years experience; or Bachelor degree in Computer Science, or MIS, with a minimum of 5 years of experience; or a Master degree in Computer Science, MIS, with a minimum 3 years of experience; or relevant Business or IT experience of minimum of 7 years. Minimum of 4 years of programming preferred
• Above noted requirements plus demonstrated ability to lead technical design decisions on AI systems, mentor junior engineers, and drive adoption of best practices across teams
• Experience with agentic AI patterns including tool use, multi-agent orchestration, memory management, and reasoning loops using LangGraph or similar frameworks
• Exposure to healthcare data standards (e.g., FHIR/HL7) and regulated or privacy-sensitive environments
• Experience with structured output generation, function calling, and tool-augmented LLMs
• Comfort working with AI-assisted development environments (e.g., GitHub Copilot, Cursor) while maintaining code quality and security standards
• Comfort with lightweight discovery methods such as analytics, user interviews, and partnering with design and UX research to validate AI-driven solutions
• Interest in responsible AI practices, including bias evaluation, content moderation, and ethical deployment considerations