Key skills

Cloud native backend servicesAI/LLM inference pipelinesPythonFastAPIAsync programmingLangChainLangGraphLLM embeddingsRetrieval-Augmented Generation (RAG)Vector searchPrompt engineeringContext engineeringModel versioningModel packagingModel servingModel monitoringReal-time inferenceBatch inferenceEvent-driven integrationsContainerized servicesKubernetes debuggingHelm deploymentsService Level Objectives (SLOs)CI/CD automationTestingSystems designConcurrencyCachingRate limitingData engineeringAzureAzure Kubernetes Service (AKS)JavaAILLMRAGAgenticData EngineeringKubernetesHelmCI/CD

About this role

HireOn Tech is seeking a Solution Lead/Java Technical Lead to build and productionize cloud native backend services and AI/LLM inference pipelines. The role involves designing and developing APIs and microservices, implementing LLM capabilities, and ensuring operational readiness and performance.

Responsibilities:

Build and productionize cloud native backend services and AI/LLM inference pipelines
Design and develop Python-based APIs and microservices (FastAPI, async patterns) and agentic AI workflows using LangChain/LangGraph
Implement and optimize LLM capabilities including embeddings, RAG, vector search, prompt/context engineering, and model versioning
Package, serve, and monitor models for real-time and batch inference, ensuring operational readiness and performance
Build event driven, resilient integrations and containerized services, with hands-on Kubernetes debugging and Helm-based deployments
Establish observability, SLOs, CI/CD automation, testing
Apply strong systems design principles (concurrency, caching, reliability, rate limiting) and robust data engineering practices