Senior Software Engineer (Pipeline team)

Foundation AI is the only AI Native document intake automation platform serving the claims and litigation industries. They are seeking a Senior AI/ML Engineer to help expand their next-generation document intelligence system, collaborating closely with the Data Science team to enhance the system's capabilities and performance.

Responsibilities:

• Retrieval-Augmented Generation: Design and build RAG architectures for document understanding, classification, and extraction — from chunking and indexing through retrieval quality and grounding
• LLM Feature Development: Ship production LLM-powered features end-to-end, from prompt design through evaluation — not just prototypes
• Evaluation-Driven Development: Build regression suites, confidence calibration methods, and evaluation frameworks that make AI output quality measurable
• Collaboration with Data Science: Partner closely with our Data Science team to bring research-grade techniques into production
• ML Pipeline & MLOps: Own model, data, and prompt versioning; build reproducible pipelines for ingestion, training, evaluation, and serving
• Rollout Automation & A/B Testing: Implement canary deployments, side-by-side A/B testing, and rollback mechanisms for safe model and prompt releases
• Monitoring & Observability: Implement drift detection, data quality monitoring, and alerting; define SLOs for model and pipeline health
• System Architecture & Leadership: Design secure, high-performance ML infrastructure; evaluate tooling (Bedrock, MLflow, Airflow); mentor engineers and influence best practices

Requirements:

• 5+ years in software engineering, with 2–3 years focused on ML/AI in production systems
• Hands-on experience with prompt engineering, RAG architectures, and evaluation-driven development — with a track record of shipping LLM-powered features real users rely on
• Practical experience with model/data/prompt versioning, experiment tracking, and deployment automation; proficiency with Airflow, MLflow, and Bedrock or equivalents
• Proficient in Python; comfortable with SQL and data engineering patterns
• A B.Tech degree in Computer Science or equivalent experience relevant to the functional area
• Working understanding of classical ML methods (gradient boosting, embeddings, calibration) sufficient to collaborate closely with Data Science
• AWS infrastructure experience (S3, ECS/EKS, Lambda)
• Familiarity with agent frameworks (LangChain, MCP) is a bonus