Boehringer Ingelheim is a global leader in healthcare, and they are seeking a Software Engineer - Full Stack AI to design, build, and integrate AI-powered solutions into applications. The role involves collaborating with product and engineering teams to develop and implement AI features, maintain existing systems, and stay current with AI/ML advancements.
Responsibilities:
- AI Integration & Development: Design and implement LLM-based features and pipelines using frameworks such as LangChain and LangGraph. Build and maintain Retrieval-Augmented Generation (RAG) systems, including vector store management, chunking strategies, embedding pipelines, and retrieval optimization
- Prototyping & Experimentation: Rapidly explore and evaluate new AI capabilities, tools, and approaches. Translate ambiguous problem statements into working prototypes that demonstrate value and inform product direction
- Collaboration & Requirements Gathering: Meet regularly with IT colleagues, product owners, and stakeholders to understand business needs and translate them into well-scoped AI engineering solutions. Communicate tradeoffs clearly across technical and non-technical audiences
- Application Support: Maintain and improve existing AI-integrated systems, troubleshoot pipeline failures, and take corrective action on issues related to retrieval quality, prompt behavior, or model outputs
- Project Participation: Contribute to project teams by delivering on assigned tasks and action items, participating in agile ceremonies, and supporting delivery against team goals
- Technical Awareness: Stay current with the rapidly evolving AI/ML landscape, including emerging LLM capabilities, new tooling, and best practices for responsible AI development
- Documentation: Produce clear documentation for AI workflows, integration patterns, prompt templates, and system architecture in support of both operational and project activities
Requirements:
- Proficiency in Python for AI/ML development and backend service integration
- Hands-on experience with LangChain and/or LangGraph for building agentic and multi-step LLM workflows
- Strong understanding of RAG pipelines end-to-end: document ingestion, chunking, embedding, vector storage, and query-time retrieval
- Familiarity with leading LLM providers and APIs (e.g., OpenAI, Anthropic, Azure OpenAI, AWS Bedrock)
- Experience with evaluation and testing of AI systems, including retrieval quality metrics, LLM output assessment, and regression testing for prompt changes
- Understanding of AI observability and experimentation tooling (e.g., LangSmith, Weights & Biases, or equivalent)
- Working knowledge of vector databases and semantic search principles
- Solid foundation in software engineering practices: version control (Git), CI/CD, and containerization (Docker)
- Effective communication skills with the ability to explain AI system behavior and limitations to non-technical stakeholders
- Associate degree in Computer Science or MIS with a minimum of 4 years experience; or Bachelor degree in Computer Science, or MIS, or related field with a minimum of 2 years of experience; or a Master degree in Computer Science, MIS, with minimum 1 year of experience; or relevant Business or IT experience of minimum of 4 years
- Hands-on experience building and shipping software in Python, with working knowledge of REST API development and integration patterns
- Demonstrated experience integrating LLMs into applications using frameworks such as LangChain, LangGraph, or equivalent
- Practical understanding of RAG architectures, including embedding models, vector databases (e.g., FAISS, Chroma, Pinecone, Weaviate), and retrieval strategies
- Familiarity with prompt engineering techniques, including few-shot prompting, chain-of-thought, and system prompt design
- Knowledge of software development lifecycle and experience working on agile project teams
- Associate degree in Computer Science, MIS or a related field with a minimum of 7 years experience; or Bachelor degree in Computer Science, or MIS, with a minimum of 5 years of experience; or a Master degree in Computer Science, MIS, with a minimum 3 years of experience; or relevant Business or IT experience of minimum of 7 years. Minimum of 4 years of programming preferred
- Above noted requirements plus demonstrated ability to lead technical design decisions on AI systems, mentor junior engineers, and drive adoption of best practices across teams
- Experience with agentic AI patterns including tool use, multi-agent orchestration, memory management, and reasoning loops using LangGraph or similar frameworks
- Exposure to healthcare data standards (e.g., FHIR/HL7) and regulated or privacy-sensitive environments
- Experience with structured output generation, function calling, and tool-augmented LLMs
- Comfort working with AI-assisted development environments (e.g., GitHub Copilot, Cursor) while maintaining code quality and security standards
- Comfort with lightweight discovery methods such as analytics, user interviews, and partnering with design and UX research to validate AI-driven solutions
- Interest in responsible AI practices, including bias evaluation, content moderation, and ethical deployment considerations