Senior Software Development Engineer - GenAI

CVS Health is building a more connected, convenient, and compassionate health experience. The team is hiring a Senior Software Development Engineer to design and build foundational AI/GenAI platform services that support internal LLM-driven tooling, including routing, cost governance, RAG, observability, and orchestration. The role focuses on creating secure, scalable, and compliant platform services for enterprise engineering teams operating in a healthcare environment.

Responsibilities:

• Design and build core platform services — spanning areas like auth, quota/cost management, observability, and routing policy
• Help define what our next generation of foundational AI services looks like as the GenAI landscape evolves
• Own the foundational AI/GenAI platform services that power CVS Health's internal agentic and LLM-driven tooling
• Make it fast, safe, and cost-effective for engineering teams across the enterprise to build with LLMs
• Navigate the compliance realities of operating in a healthcare environment (PHI/PII handling, HIPAA, BAA requirements with model providers)

Requirements:

• • 5+ years of professional software engineering experience, including 2+ years building production backend services in Python and/or TypeScript/Node.js

• 2+ years of experience designing and building RESTful APIs or microservices using frameworks such as FastAPI, Flask, Express, or NestJS
• Experience integrating with one or more LLM/AI provider APIs (e.g., Anthropic, OpenAI, AWS Bedrock, Google Vertex AI) in a production system
• Experience with at least one major cloud provider (AWS, Azure, or GCP)
• Experience with the following (or equivalents): Redis, Kafka, and MongoDB in a production environment
• Experience with OAuth2/OIDC or JWT-based authentication and authorization systems
• Experience with observability/telemetry tooling (e.g., OpenTelemetry, Prometheus, Grafana, Langfuse, Datadog)
• Experience with containerized applications (Docker) and CI/CD pipelines
• Experience with version control systems (Git) and code review processes

Education
Bachelor's degree or equivalent work experience in Mathematics, Statistics, Computer Science, Analytics, Engineering, or related discipline. Master's degree preferred 

• • Genuine, self-motivated curiosity about GenAI and emerging AI infrastructure — someone who follows the space on their own and shows up with new ideas, tools, or approaches unprompted

• Strong team player who collaborates readily and shares ideas openly, even while operating on a team of senior engineers with established conventions
• Comfortable respectfully challenging established patterns and proposing alternatives as part of a collaborative team dynamic
• Prior experience building LLM/GenAI infrastructure itself (e.g., LLM gateways, agentic orchestration systems, RAG platforms) — not just consuming provider APIs, but designing the systems around them
• Ability to reason about system design trade-offs in distributed, stateful systems (e.g., cache invalidation, consumer group rebalancing, blue-green deployment of stateful services)
• Strong written and verbal communication skills, with the ability to explain technical trade-offs to both engineers and non-technical stakeholders
• Comfort operating with ambiguity and evolving requirements in a fast-moving technical landscape
• Experience or interest in prompt engineering, model routing strategies, or LLM cost optimization techniques
• Experience in a regulated industry (healthcare, finance, or similar), with familiarity around compliance considerations for sensitive data (PHI/PII)
• Interest in eventually growing into technical leadership on a specific platform service
• Collaborative mindset with a bias toward building reusable, well-documented internal tooling