Senior RAG Engineer

Wipfli is a company that values its people and focuses on creating exceptional impact through AI-powered solutions. As a Senior RAG Engineer, you will be instrumental in developing an AI-driven platform for automating complex project documentation, collaborating with various teams to deliver impactful capabilities.

Responsibilities:

• Design, develop, and optimize full‑stack applications using RAG for high‑accuracy retrieval and generation
• Build and maintain APIs and microservices with monitoring and logging for reliability and performance
• Implement vector databases and semantic search; fine‑tune retrieval for strong precision and recall
• Optimize chunking, embeddings, and retrieval parameters tailored to professional services content
• Evaluate LLM architectures and maintain prompt‑engineering frameworks to improve response quality
• Build ETL pipelines and integrate with firm platforms such as document management, CRM, and engagement systems
• Ensure data quality, security, and compliance, including role‑based access, encryption, audit logging, and confidentiality
• Partner across teams—engagement, data science, and ML—to deliver capabilities and mentor junior engineers
• Stay current on emerging AI/ML technologies and assess applicability to enterprise use cases

Requirements:

• Bachelor's degree in Computer Science, Information Management, Data Science, or AI related field
• 3-5 years of experience in data science and AI roles
• 7-10 years of experience software development roles
• Demonstrated track record of building production-grade AI applications from conception to deployment
• Demonstrated deep understanding of RAG methodologies and practical application. Experience with frameworks such as LangChain, LlamaIndex, or Haystack is considered an additional asset
• Experience with document processing and OCR technologies, including integration and deployment within enterprise environments
• Master's degree or advanced certification in Data Science or AI
• 4+ years of full stack development experience with modern frameworks (React, Vue, or Angular; Node.js, Python, or similar; .NET experience)