CACI International Inc is seeking a Lead AI Engineer to research, design, and build Artificial Intelligence (AI) and Machine Learning (ML) solutions. The role involves working with a cross-functional team to develop AI-driven features and deployment pipelines across various use cases, including Generative AI.
Responsibilities:
- Forward thinking vision of how RAG can be integrated within a software development lifecycle and business practices, keeping abreast of new developments in RAG, NLP, and related fields
- Designing and implementing retrieval systems: Creating efficient ways to store and quickly access large amounts of relevant information
- Implementing safeguards: Developing mechanisms to prevent the system from retrieving or generating inappropriate or harmful content
- Developing and fine-tuning language models: Working with large language models to optimize their performance for specific tasks and domains
- Evaluation and testing: Designing and conducting tests to measure the system's accuracy, relevance, and overall performance
- Integrating retrieval and generation components: Ensuring seamless interaction between the retrieval system and the language model
- Follow a CACI agile methodology, attending daily standups, refinement sessions, and updating agile project management system to ensure transparency
- Design and implement agentic workflows using supervisor and orchestration patterns with frameworks such as LangGraph, CrewAI, or similar multi-agent orchestration tools
- Establish observability and evaluation pipelines using tools like Langfuse, LangSmith, or similar platforms to monitor, trace, and assess LLM application performance
Requirements:
- Bachelor's degree in computer science, software engineering, or a related field
- 7 years of software development experience with 2-5 years of relevant experience in NLP, machine learning, or AI development
- Experience designing agentic flows using supervisor, routing, and hierarchical patterns with frameworks such as LangGraph or equivalent
- Experience with Linux and Linux based terminals
- Understanding of RAG architecture and principles, experience implementing RAG systems, and familiarity with popular RAG frameworks and tools
- Knowledge of security best practices for AI systems
- Strong programming skills, particularly in Python, Javascript, rust, golang
- Experience with vector databases, embedding techniques, and data pipelines
- Experience with information retrieval systems
- Experience with RESTful APIs and Cloud Services (AWS, OCI)
- Experience with data preprocessing, normalization, cleaning, encoding data into vector representations
- Knowledge of text analytics and semantic search techniques
- Experience with prompt engineering
- Experience working with multiple teams in an agile environment, with data scientists, UI/UX designers, and subject matter experts to improve the overall system
- Self-motivated with ability to quickly adapt and learn emerging disciplines and techniques
- Active Secret or Top-Secret clearance
- T5 level background investigation (possesses or must be able to obtain)
- Familiarity with version control systems (e.g., Git)
- Experience with containerization (e.g., Docker)
- Experience with relational databases, including schema design
- Experience implementing observability, tracing, and evaluation frameworks for LLM-based applications
- Understanding of CI/CD pipelines