Senior Software Engineer, Data & AI Engineering (US)

Scrunch is a venture-backed startup focused on transforming marketing through AI technologies. The Senior Software Engineer will be responsible for building features related to data pipelines and analytics APIs, ensuring that customers have the tools to succeed in the AI era.

Responsibilities:

• Building features related to data pipelines, usage of LLMs, analytics APIs, etc
• Creating notifications, alert emails, scheduled reports, connectors into third party systems

Requirements:

• Have extensive experience building & using web APIs, including handling authentication, authorization, caching, rate limiting, etc
• Experience building API for external customers is a big plus
• Experience with relational (transactional) databases, particularly PostgreSQL
• Experience with analytics tools and technologies, such as: Analytical SQL, maybe with a modern analytical data platform like Snowflake, Google BigQuery, DuckDB, Spark SQL, etc
• Experience with analytics packages like Pandas or Polars is a plus
• Experience with streaming analytics is a plus
• Experience writing batch and streaming/interactive data processing pipelines
• This could mean any of: Big data tools like Flink, Beam (GCP Dataflow), Spark, etc
• Job queues and task processing frameworks (Celery, Resque, or cloud-based options like Google Cloud Tasks)
• Multi-step durable execution frameworks like Temporal or Inngest
• In-house or home-rolled versions of any of the above you've used at previous companies
• The ability to quickly understand source data and validate output data quality
• Experience using LLMs and/or traditional ML techniques to build classifiers, data extractors, summarizers, etc
• Experience building evals for LLM-based tools to assess and improve accuracy at these kinds of tasks