Key skills
Full-stack developmentAI/ML-driven applicationsPythonCloud-based servicesAWSDockerRESTful APIsFrontend technologiesReactTypeScriptVueLLM integrationRetrieval-augmented generation (RAG) pipelinesPrompt engineeringOrchestration frameworksLangChainLlamaIndexDistributed systemsAPIsMicroservicesContainer orchestrationECSEKSCloud platformsGCPAzureSecure codingAuthenticationAuthorizationData governanceUser empathyTechnical ownershipAIMLGenAILLMOpenAIClaudeGeminiRAGQdrantPineconeOktaRESTful
About this role
Okta is a company focused on securing identities to unlock the potential of AI. They are seeking a Senior Software Engineer, Applied AI to build user-facing and backend systems that leverage GenAI to enhance internal experiences and operations.
Responsibilities:
- Design and build end-to-end GenAI-powered applications, including web-based UIs, API services, and backend orchestration
- Implement and integrate LLM-based experiences using frameworks like LangChain, LlamaIndex, and tools like OpenAI, Claude, or Gemini
- Define, implement, and champion operational excellence standards (SLOs, observability, incident response frameworks) for all services deployed
- Develop responsive, accessible, and modern frontend interfaces using frameworks like React or Vue — with a focus on usability, performance, and trust in AI outputs
- Build and maintain a library of reusable frontend components and hooks that allow other business delivery teams to easily 'drop in' GenAI capabilities into their own applications
- Build and maintain retrieval-augmented generation (RAG) pipelines with vector search and embedding strategies (e.g., Pinecone, FAISS, Qdrant)
- Collaborate with designers and product managers to rapidly iterate on UX patterns for AI-powered experiences (e.g., prompt inputs, citations, summaries)
- Ensure security, privacy, observability, and test coverage across the full stack
- Contribute to architecture decisions, engineering standards, and best practices for AI/automation systems
- Partner with platform and infrastructure teams to ensure services scale reliably across the org
Requirements:
- 5–8 years of software engineering experience with full-stack development, including 2+ years of building AI/ML-driven applications
- Strong Python development skills and 5+ years experience building cloud-based services using AWS, Docker, and RESTful APIs
- 2+ years of experience in frontend technologies like React, TypeScript, or Vue, and comfort working on UI/UX for internal tools or enterprise applications
- Hands-on experience with LLM integration, RAG pipelines, prompt engineering, or orchestration frameworks like LangChain or LlamaIndex
- Strong background in distributed systems, APIs, microservices, container orchestration (ECS/EKS), and cloud platforms (AWS/GCP/Azure)
- Familiarity with secure coding, authentication/authorization, and internal data governance best practices
- Ability to collaborate across engineering, design, and product teams — with a strong sense of user empathy and technical ownership
- Exposure to design systems, AI evaluation tooling, or real-time application performance monitoring