Software Development Engineer 3

iSpot is hiring a Software Development Engineer 3 for its Ad Optimization team. The role builds and operates Spark and Snowflake data pipelines and partner integrations that deliver TV and streaming measurement feeds for campaign optimization.

Responsibilities:

• Build, tune, and maintain large-scale batch Spark pipelines that turn measurement data into partner-ready optimization feeds
• Build and optimize Snowflake processing, including SQL transformations, scheduled and incremental pipelines, and data modeling
• Tune pipeline performance and cost across Spark and Snowflake
• Design data models, table layouts, and partitioning across S3, lakehouse tables, and Snowflake
• Build partner data feeds, including file and API deliveries, identity matching, privacy-sensitive data handling, and delivery SLAs
• Build data-quality checks, reconciliation, telemetry, and alerting, and handle late-arriving data and backfills
• Write and review technical designs and test plans, and lead small-to-medium projects from ambiguous requirements to production
• Own releases and deployments to team standards, including staged rollouts and rollback
• Participate in the team's on-call rotation. You will respond to alerts and incidents, lead root-cause analysis, and keep runbooks current
• Mentor other engineers through code review, pairing, and design feedback
• Use AI-assisted tools for design, development, testing, and incident work, and verify what they produce

Requirements:

• Applicants must be currently authorized to work in the United States
• iSpot is not able to sponsor or take over sponsorship of an employment visa for this position at this time
• 5+ years of professional software or data engineering experience
• 3+ years building, optimizing, and operating production Apache Spark pipelines in Java or Scala and in Python/PySpark
• 2+ years of production Snowflake experience, including complex SQL transformations, performance and cost tuning (warehouse sizing, clustering, query profiling), and tasks and streams or dynamic tables for scheduled and incremental processing
• 2+ years running data workloads on AWS, including S3 and Spark on Kubernetes (EKS) or EMR
• Production experience with Airflow or an equivalent workflow orchestrator
• Advanced SQL and relational data modeling
• Experience building external partner or client data feeds that involve file and API deliveries, identity matching, privacy-sensitive data, and delivery SLAs
• Experience designing data-quality checks, reconciliation, telemetry, and alerting for batch pipelines, including handling late-arriving data and backfills
• Experience writing unit and integration tests for data pipelines
• Production ownership experience covering CI/CD, releases and rollback, incident response, and root-cause analysis
• Experience writing and reviewing technical designs and leading small-to-medium engineering projects through production delivery
• Experience mentoring engineers through code review, pairing, and design feedback
• Experience using AI-assisted engineering tools responsibly, with appropriate verification for security, correctness, and maintainability
• Experience with Snowflake external Iceberg tables and catalog integrations, secure data sharing, or Snowpark (Python)
• Experience with Apache Iceberg and MySQL
• Experience running Spark on Amazon EKS and Airflow on Amazon MWAA
• Experience in ad tech or advertising measurement, such as attribution, conversions, audience and impression data, identity matching, or partner optimization feeds