Key skills
PythonAWS cloud servicesContainerizationETL/ELT processingMachine learning conceptsFinancial APIsData management toolsNetworking knowledgeLinux/UnixcommunicationAIMachine LearningLLMETLELTAWSTerraformKubernetesDockerECSRESTfulCommunication
About this role
Yahoo is the world’s #1 finance destination, empowering investors with news, information, and tools to make financial decisions with confidence. As a Principal Software Engineer, you will collaborate with key stakeholders to define strategies for the AI platform, focusing on building scalable components and enhancing user experience for Yahoo Finance products.
Responsibilities:
- Define and lead the vision for building scalable AI pipeline components, databases, and API endpoints
- Design event-driven microservices architectures for processing large-scale financial datasets
- Write production and prototype code for containerized data processing workflows
- Collaborate with product and engineering teams to gather requirements and drive feature development
- Develop integrations with multiple LLM providers and machine learning platforms
- Implement real-time data processing pipelines with message queuing and fanout patterns
- Collaborate effectively as both a visionary leader, a team player, individual contributor, and mentor junior engineers
Requirements:
- Strong computer science fundamentals (MS or equivalent in CS) : Python, data structures, algorithms, distributed systems and information retrieval
- 5+ years experience in platform engineering with focus on data-intensive applications
- Experience with ETL/ELT processing and data management tools
- Deep functional knowledge and hands on experience with: AWS cloud services, RESTful Web Services, Containerization (Docker, ECS, Kubernetes), IaC (Terraform)
- An excellent understanding of networking, I/O, and Linux/Unix
- Strong coding background; experience writing production code
- Excellent communication skills
- Experience building AI applications and LLM integrations
- Familiarity with machine learning concepts and model deployment
- Knowledge of vector databases and retrieval systems
- Experience with prompt engineering and AI workflow orchestration
- Understanding of financial datasets and market data processing
- Experience with financial APIs and real-time data feeds
- Knowledge of financial analysis concepts and metrics
- Familiarity with regulatory data processing requirements