Senior Software Engineer, Data & AI Engineering (US)

Scrunch is a venture-backed startup focused on transforming marketing through AI technologies. They are seeking a Senior Software Engineer for their Data & AI Engineering team to build features related to data pipelines and analytics APIs, contributing to the company's mission of enabling brands to thrive in an AI-first future.

Responsibilities:

• Building features related to data pipelines, usage of LLMs, and analytics APIs
• Delivering value to customers through various tasks including light React work, creating notifications, alert emails, scheduled reports, and connectors into third party systems

Requirements:

• Extensive experience building & using web APIs, including handling authentication, authorization, caching, rate limiting, etc
• Experience with relational (transactional) databases, particularly PostgreSQL
• Experience with analytics tools and technologies, such as Analytical SQL, maybe with a modern analytical data platform like Snowflake, Google BigQuery, DuckDB, Spark SQL, etc
• Experience writing batch and streaming/interactive data processing pipelines
• Big data tools like Flink, Beam (GCP Dataflow), Spark, etc
• Job queues and task processing frameworks (Celery, Resque, or cloud-based options like Google Cloud Tasks)
• Multi-step durable execution frameworks like Temporal or Inngest
• In-house or home-rolled versions of any of the above you've used at previous companies
• The ability to quickly understand source data and validate output data quality
• Experience using LLMs and/or traditional ML techniques to build classifiers, data extractors, summarizers, etc
• Experience building API for external customers
• Experience with analytics packages like Pandas or Polars
• Experience with streaming analytics
• Not required but a big plus: experience building evals for LLM-based tools to assess and improve accuracy at these kinds of tasks