Home
Jobs
Saved
Resumes
Senior Lead Data & AI Engineer at Vanguard | JobVerse
JobVerse
Home
Jobs
Recruiters
Companies
Pricing
Blog
Jobs
/
Senior Lead Data & AI Engineer
Vanguard
Website
LinkedIn
Senior Lead Data & AI Engineer
Canada
Full Time
5 hours ago
Visa Sponsorship
Apply Now
Key skills
AWS
Cloud
Unity
AI
ML
RAG
Agentic
Data Engineering
Databricks
Glue
SageMaker
Bedrock
About this role
Role Overview
Architect and build reusable, metadata-driven data and AI engineering frameworks
Leverage Databricks, lakehouse architecture, declarative pipelines, and cloud-native services
Architect and deploy Delta Live Tables and Lakeflow jobs on Databricks
Leverage Databricks Workflows and Job Orchestration to schedule and monitor AI agent deployments
Integrate Lakeflow for real-time data stream processing
Ensure seamless orchestration between AI models and data pipelines
Implement and orchestrate AI agents using frameworks such as Agentic systems, AgentOps tooling
Hands-on experience deploying AI agents using RAG, Graph RAG, MCP-enabled integrations
Manage AI agent lifecycles, monitoring, and scaling using tools like SageMaker
Ensure robust data governance and AI observability through Unity Catalog, AWS Glue
Requirements
9–12+ years in data engineering, specializing in AI deployment within cloud ecosystems (Databricks, AWS)
Hands-on experience deploying AI agents using frameworks like RAG, graph RAG, and orchestrating agents (AgentOps, Agent-bricks, etc.)
Proficient in AWS AI/ML services (SageMaker, Bedrock) and orchestration tools (MWAA, Step Functions)
Strong knowledge of lakehouse architecture, Unity Catalog, and data modeling best practices
Deep experience in data orchestration, monitoring, and scalable AI-driven workflows.
Tech Stack
AWS
Cloud
Unity
Benefits
Flexible working arrangements
Professional development
Health insurance
Retirement plans
Apply Now
Home
Jobs
Saved
Resumes