Alvys is the fastest-growing Transportation Management System (TMS) in history, uniquely positioned to dominate and truly revolutionize the $800 billion US transportation logistics industry. As a Senior Data Engineer, you will be the primary architect of our data ecosystem, defining our LLM-based data strategy and enabling large-scale ML model deployment while ensuring our data infrastructure supports operational needs and scales for the future.
Responsibilities:
- Define and implement the strategy for LLM-based data products, including data preparation, semantic layer design, and embedding pipelines for RAG-based applications
- Own the design and evolution of our Snowflake architecture. Lead the implementation of Snowflake Cortex for AI/ML workloads, including semantic models and LLM agents
- Design and maintain reliable, performant ELT/Reverse ETL pipelines. Ensure our multi-tenant SaaS data remains isolated, secure, and performant at scale
- Build and operationalize pipelines for large-scale ML and LLM model development, moving from POC to production-grade deployment within the Snowflake perimeter
- Think holistically about the data estate. Reduce complexity through modularity and well-defined service boundaries (e.g., Medallion Architecture)
- Serve as the go-to expert for emerging data trends. Mentor engineers and partner with Product and Design to translate complex business logic into automated deliverables
Requirements:
- 5+ years of experience in Data Engineering with a proven track record of delivering mission-critical data platforms
- Deep proficiency in Snowflake (Data Modeling, Query Optimization, Security, and Cortex AI functions)
- Expert-level skill in SQL and Python
- Extensive experience with dbt and modern orchestration (Airflow/Dagster)
- Demonstrated experience building pipelines for ML or LLM-based applications, including feature engineering and model deployment
- Competency in Azure (preferred) or other major cloud providers, including CI/CD and infrastructure-as-code principles
- Experience driving cross-team consensus on architectural decisions and mentoring junior/mid-level engineers