Senior Data Engineer

Description

We are looking for a Data Engineer to join the client's User Platforms organization. This role will be responsible for building and scaling the data foundation that powers experimentation, causal analysis, product optimization, and decision-making across Disney+, Hulu, ESPN+, and other streaming products.

Key Responsibilities:

Design, develop, and maintain scalable experimentation data platforms supporting A/B testing, geo experiments, feature launches, and product analytics.

Build and optimize batch and streaming data pipelines that ingest, transform, validate, and serve large-scale user behavior, product, and engagement datasets.

Create reusable experimentation frameworks, datasets, and tooling that enable teams to efficiently define experiments, measure outcomes, and analyze results.

Design dimensional models, analytical data products, and feature-ready datasets optimized for analytics, experimentation, and machine learning use cases.

Implement automated data quality validation, monitoring, lineage tracking, testing, and governance controls to ensure reliable and trustworthy experiment results.

Develop production-ready deployment workflows, CI/CD pipelines, observability solutions, and operational processes for data products and services.

Collaborate with Product Managers, Software Engineers, Data Scientists, and Analytics teams to translate business requirements into scalable technical solutions.

Drive best practices for data architecture, engineering standards, experimentation methodologies, and platform reliability.

Mentor engineers and promote a culture of technical excellence, innovation, experimentation, and continuous improvement.

Requirements

Core Qualifications:

Bachelor's degree in Computer Science, Engineering, Mathematics, Statistics, Physics, or a related technical discipline.

7+ years of experience in Data Engineering, Analytics Engineering, Data Platform Engineering, or related fields.

Strong experience designing, building, and supporting large-scale distributed data pipelines and data platforms.

Deep understanding of data modeling, ETL/ELT architectures, data warehousing, lakehouse technologies, and streaming data systems.

Hands-on experience building data solutions that support experimentation, product analytics, personalization, customer insights, or machine learning initiatives.

Advanced proficiency in SQL and Python.

Experience with modern data engineering technologies such as Databricks, Snowflake, Apache Spark, Kafka, Airflow, or comparable platforms.

Experience implementing automated testing, monitoring, data quality frameworks, observability, and governance processes.

Strong knowledge of cloud-based data ecosystems and distributed computing environments.

Ability to communicate complex technical concepts to both technical and non-technical stakeholders.

Proven ability to lead large-scale technical initiatives and deliver highly reliable production-grade data solutions.

Technology Doesn't Change the World, People Do.

Robert Half is the world's first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.

Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app and get 1-tap apply, notifications of AI-matched jobs, and much more.

Robert Half will consider for employment qualified applicants with arrest or conviction records in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit roberthalf.gobenefits.net for more information.

2025 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking "Apply Now," you're agreeing to Robert Half's Terms of Use and Privacy Notice.