Lead applications systems analysis, design, and programming activities in alignment with Citi’s enterprise architecture
Partner with multiple management teams to integrate systems, deploy new products, and enable process improvements
Resolve high-impact, complex problems through deep analysis of business processes, system flows, and industry standards
Establish standards for coding, testing, debugging, and implementation
Develop a strong understanding of how architecture, infrastructure, and applications integrate to achieve business goals
Provide technical mentorship and coaching to mid-level developers and analysts; allocate work as needed
Assess and manage risk in all technical and business decisions, ensuring compliance with laws, regulations, internal policies, and ethical standards
Design and implement AI-powered testing solutions, including: AI-generated test cases, Intelligent regression selection, Self-healing automation, Automated defect and failure analysis
Develop and optimize LLM-based tools for: Test data generation and scenario creation, Requirements-to-test traceability, Predictive test failure analysis
Embed generative AI capabilities into existing automation frameworks (e.g., Selenium, Playwright)
Implement advanced GenAI techniques such as prompt engineering and Retrieval-Augmented Generation (RAG) to enhance testing intelligence
Integrate AI-driven testing accelerators into CI/CD pipelines to reduce cycle time and improve stability
Support deployment, scalability, monitoring, and optimization of AI models in production environments
Contribute to real-time and streaming AI systems that enable continuous testing and rapid feedback loops
Ensure compliance with Responsible AI principles, data privacy requirements, governance standards, and quality controls
Stay current with emerging trends in generative AI and test automation; evangelize best practices across the organization
Mentor junior engineers and QA automation developers on AI-assisted testing methodologies
Requirements
6+ years of relevant experience in applications development or systems analysis
Extensive experience in systems analysis and software application development
Proven success leading and delivering complex projects
Subject Matter Expert (SME) in at least one area of applications development
Demonstrated leadership, adaptability, and project management skills
Consistently strong written and verbal communication skills
Strong hands-on experience with LLM development, fine-tuning, and optimization
Expertise in RAG systems, hybrid search, and vector retrieval
Proficiency with ML frameworks such as PyTorch, TensorFlow, and Keras, including distributed training
Experience with GenAI tools and libraries including LangChain, LlamaIndex, LangGraph, Crew.ai, Autogen, Hugging Face, and cloud GenAI APIs (e.g., OpenAI, Claude, Gemini)
Strong understanding of test automation frameworks (Selenium, Playwright)
Experience integrating AI capabilities into testing pipelines (AI-generated tests, self-healing scripts, test impact analysis)
Solid knowledge of CI/CD systems with a focus on continuous testing
Familiarity with QA methodologies, test strategy, functional and non-functional testing, and quality metrics
Advanced Python skills for automation tooling, data preprocessing, API development, and AI workflows
Experience with containerization and deployment technologies (Docker, Kubernetes)
Practical knowledge of model optimization techniques
Strong understanding of AI governance, model guardrails, testing risk frameworks, and Responsible AI practices
Excellent collaboration and communication skills, with the ability to explain AI-driven testing strategies to both technical and non-technical audiences
Analytical, proactive mindset with a passion for experimentation, innovation, and mentoring
Tech Stack
Cloud
Docker
Keras
Kubernetes
Python
PyTorch
Selenium
Tensorflow
Benefits
medical, dental & vision coverage
401(k)
life, accident, and disability insurance
wellness programs
paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays