Key skills
Java Spring BootPythonRESTful APIsMicroservices ArchitectureAsynchronous ProcessingGenerative AI APIsOpen-source AI modelsLangChainLLM orchestrationRetrieval-Augmented Generation (RAG) pipelinesPrompt EngineeringEmbedding ModelsVector DatabasesContainerizationDockerKubernetesCI/CD pipelinesMicrosoft AzureDebuggingJavaAIGenerative AILLMOpenAIRAGAgenticHugging FaceMLOpsReactAngularNode.jsFastAPISpring BootSpringAWSAzureGCPRESTfulCI/CD
About this role
Allstate is a company dedicated to protecting families and their belongings from life's uncertainties. They are seeking a Senior AI Software Engineer to design and develop backend services while integrating Generative AI technologies into their enterprise applications.
Responsibilities:
- Design, develop, and maintain backend services and APIs using modern frameworks (e.g., Java Spring Boot, Node.js, or Python FastAPI)
- Integrate and deploy Generative AI models (e.g., OpenAI, Hugging Face, LangChain) into production environments
- Fine-tune and optimize LLMs for specific use cases
- Build secure, scalable, and high-performance microservices
- Monitor and improve system performance, reliability, and scalability
- Implement CI/CD pipelines, containerization (Docker), and orchestration (Kubernetes)
- Deploy and manage applications on cloud platforms, preferably Microsoft Azure
- Participate in code reviews, testing, and continuous integration processes
Requirements:
- 3+ years of backend development experience using Java Spring Boot or Python
- Strong understanding of RESTful APIs, microservices architecture, and asynchronous processing
- Experience working with Generative AI APIs and/or open-source models
- Experience with LangChain, LLM orchestration, or RAG (Retrieval-Augmented Generation) pipelines
- Familiarity with prompt engineering, embedding models, or vector databases
- Strong problem-solving and debugging skills
- 4 year Bachelor's Degree
- 4 or more years of experience
- Exposure to multi-modal AI systems and agentic AI frameworks
- Exposure to MLOps and model deployment workflows
- Experience with Docker, Kubernetes, and CI/CD pipelines
- Experience with cloud platforms (Azure, AWS or GCP)
- Knowledge of frontend frameworks like React or Angular