Senior Data Engineer

Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. The Senior Data Engineer role involves building and maintaining the data engineering infrastructure that powers analytics delivery, working closely with data scientists and analytics teams to enhance data pipelines and deliver data at scale.

Responsibilities:

• Own the Airflow codebase end-to-end (MWAA, ~100 DAGs currently): build reusable templates, scale patterns, enforce standards, improve testing infrastructure
• Serve as delivery teams’ go-to on pipeline architecture and troubleshooting
• Own data onboarding when we connect to a new source including connection setup, schema discovery, initial pipeline design
• Operate and extend large-scale Spark pipelines on AWS Glue, including multi-TB joins and compaction jobs, and support migration of those workloads to Databricks as we move platforms
• Drive data model improvements around our commercial pharma data (patient claims, KOL and HCP data, CRM activity) with a focus on structure, lineage, and how it flows through the platform
• Contribute to and maintain our internal Python package used across the data team

Requirements:

• 5+ years building data models and pipelines
• 2+ years production Airflow experience
• 2+ years Spark at scale: hands-on experience with multi-TB datasets; AWS Glue experience preferred
• Strong python and SQL
• AWS fluency in S3, ECS/Fargate, Glue, IAM, Secrets Manager
• Clear communicator who can teach: onboarding analytics team to the codebase and developing team Airflow capability is a core part of this job, not a side responsibility
• Experience working with privacy-sensitive or governed data
• Databricks experience – we're actively migrating Glue workloads there
• Proficiency with Claude Code
• Exposure to data science workflows and ML pipeline tooling
• Background in life sciences or healthcare
• Experience with Open Meta data or similar data catalog and data dictionary tooling