Home
Jobs
Saved
Resumes
Staff Data Engineer at The Palette | JobVerse
JobVerse
Home
Jobs
Recruiters
Companies
Pricing
Blog
Jobs
/
Staff Data Engineer
The Palette
Website
LinkedIn
Staff Data Engineer
United States
Full Time
2 hours ago
$155,584 - $320,320 USD
Apply Now
Key skills
AWS
Cloud
Scala
Spark
Data Engineering
Analytics
Communication
Collaboration
About this role
Role Overview
Design and maintain a scalable identity resolution platform
Build pipelines and services to ingest, normalize, link, and version identity data across multiple sources
Ensure deterministic and probabilistic matching logic that is transparent, auditable, and measurable
Partner with product and analytics teams to expose identity data through reliable, well-documented APIs and datasets
Build and operate batch and streaming pipelines using modern data stack tools
Create clear documentation, standards, and runbooks for identity and governance systems
Own data governance foundations including data lineage, quality checks, schema enforcement, and access controls
Implement privacy-by-design principles (PII handling, consent enforcement, retention policies)
Collaborate with legal, privacy, and security teams to operationalize regulatory requirements (e.g., GDPR, CCPA)
Establish monitoring and alerting for data quality, freshness, and integrity
Requirements
Data engineering experience with proven track record building data infrastructure using Spark with Scala
Proven experience building data infrastructure using Spark with Scala for at least 5 years
Experience in delivering significant technical initiatives and building reliable, large scale services
Experience in delivering APIs backed by relationship-heavy datasets
Experience implementing data governance practices, including data quality, metadata management, and access controls
Strong understanding of privacy-by-design principles and handling of sensitive or regulated data
Familiarity with data lakes, cloud warehouses, and storage formats
Strong proficiency in AWS services
Successful design and implementation of scalable and efficient data infrastructure
High attention to detail in implementation of automated data quality checks
Effective collaboration with cross-functional teams
Excellent written and verbal communication skills
Bachelor's degree in Computer Science or a related field.
Tech Stack
AWS
Cloud
Scala
Spark
Benefits
Information regarding the culture at Pinterest and benefits available for this position can be found here.
Apply Now
Home
Jobs
Saved
Resumes