AWSCloudKubernetesPythonMLLLMLarge Language ModelsRAGAgenticAutoGenELTAnalyticsFastAPIWebSocketsECSEKSIAMPerformance OptimizationCI/CDMentoringPrototyping
About this role
Role Overview
Design, develop, and maintain high-performance, scalable, and secure backend services, primarily using Python and frameworks like FastAPI
Translate ambiguous business and technical requirements into concrete software designs and actionable tasks for cross-functional teams
Work with OLTP databases, including schema design, migration strategies, and performance optimization
Integrate SmartAsset services with internal and external APIs, including third-party platforms and existing AWS infrastructure
Ensure secure ingress and egress of data within our private network environments
Contribute to the design and implementation of our CI/CD pipelines to ensure continual improvements to our cycle time
Manage and optimize AWS services, including IAM roles and policies
Gain a deep understanding of how our Python applications integrate with our Kubernetes (EKS) and future ECS-based infrastructure
Operate and maintain production applications at scale, ensuring high availability, performance, and reliability
Design and implement data collection pipelines specifically for Large Language Models (LLMs)
Contributed to shared data architecture and data governance practices to ensure the persistence of structured data suitable for analytics and model training
Explore, integrate, and tune various LLM-related technologies, such as Retrieval Augmented Generation (RAG) systems, and addressing potential scaling challenges
Investigate and implement agentic technologies, such as tool calling frameworks (e.g., AutoGen), to enhance LLM capabilities
Rapidly prototype user interfaces for internal tools and data exploration, leveraging frameworks like Streamlit, Gradio, or other similar tools that facilitate quick iteration and integration without persistent websockets
Requirements
Proven experience as a ML Engineer with a strong focus on Python development
Experience with cloud platforms, specifically AWS, including IAM, EKS/ECS, and other core services
Experience operating and scaling a production application
Experience building integrations with internal and external service providers
Experience with LLMs, RAG, embedding vector databases, or agentic technologies.
Familiarity with productionizing apps built with prototyping frameworks such as Streamlit or Gradio
Knowledge of data governance and structured data principles
Experience with Feature Stores or ELT processes
Tech Stack
AWS
Cloud
Kubernetes
Python
Benefits
All roles at SmartAsset are currently and will remain remote
flexibility to work from anywhere in the Contiguous US.
Medical, Dental, Vision
multiple packages available based on your individualized needs
Life/AD&D Insurance
basic coverage at 100% company paid, additional supplemental available