Cloudera is a leading data partner for top companies, specializing in transforming complex data into actionable insights. The AI Solutions Engineer will serve as a technical architect and execution lead for government agencies, focusing on designing and deploying AI applications on the Cloudera Data Platform while ensuring compliance and ethical standards are met.
Responsibilities:
- Evaluate and select optimal model architectures (LLMs, SLMs, or traditional ML) based on mission requirements, considering tradeoffs between accuracy, latency, and cost
- Guide customers on "Build vs. Buy vs. Fine-tune" decisions, prioritizing open-source models (Llama, Mistral, Falcon) that can run securely within a sovereign data perimeter
- Experience building Agentic Workflows (AI agents that can execute API calls and multi-step tasks)
- Design and implement robust data pipelines within CDP to transform "messy" legacy data into AI-ready formats
- Develop and optimize Vector Databases and Retrieval-Augmented Generation (RAG) architectures to ground AI responses in verified agency facts
- Build Data pipelines with Spark, Nifi, Kafka or other ETL tools
- Optimize model inference for production environments using quantization, pruning, and hardware acceleration (NVIDIA GPU orchestration)
- Implement LLMOps to monitor model performance, detect hallucination rates, and manage model versioning and drift
- Collaborate with the customer’s AI Center of Excellence (CoE) to establish automated guardrails for ethics, bias mitigation, and FedRAMP/IL5 compliance
- Translate complex technical AI concepts into mission-value briefings for GS-level stakeholders and agency leadership