Dr. Berg NutritionalsRemote
Senior Data Engineer / Data Platform Lead
United States of America
Full Time
4 hours ago
$185,000 - $225,000 USD
No H1B
Key skills
Data engineeringAzure Data FactoryAzure SynapseAzure FabricAzure FunctionsAzure Data Lake Storage (ADLS)Azure MonitorSQLQuery tuningExecution plansIndexing strategyIncremental modelsData-quality validationC#PythonCommerce/ERP APIsAmazon SP-APINetSuite SuiteAnalytics ConnectInfrastructure as Code (IaC)BicepTerraformARM templatesCI/CDProduction incident managementRunbook creationMaturityRisk managementCAIData EngineeringAnalyticsBigQueryAzureShopifySalesforceERP
About this role
Dr. Berg Nutritionals is a rapidly growing company in the nutrition industry, leveraging platforms like Amazon and TikTok to drive significant revenue. They are seeking a Senior Data Engineer / Data Platform Lead to establish a unified data platform that supports executive reporting and customer-facing AI products, with the unique opportunity to set technical direction and ensure data reliability.
Responsibilities:
- In your first 90 days you'll audit every existing data source (what's flowing, what's broken, what's missing), replace our manual CSV-based Klaviyo ingestion with a direct API pipeline, stand up production pipelines for Amazon SP-API, Shopify, and NetSuite with proper monitoring, establish our infrastructure-as-code practice and CI/CD pipeline, and define the target architecture: ingestion patterns, orchestration standards, environment separation, data-quality gates, deployment workflow
- Ingestion. Amazon SP-API, Shopify Admin API, NetSuite SuiteAnalytics Connect, Klaviyo, Recharge, YouTube, GA4 (BigQuery export), Google Search Console, Google Ads, Meta Ads, Triple Whale, plus ~15 more
- Orchestration. Finance needs fresh data before morning reconciliation. YouTube has API quotas across 7,000+ videos. Klaviyo events stream continuously. You decide what runs when
- Reliability. Health checks, schema validation, freshness SLAs, source reconciliation, data-quality gates. Alerts you actually want to receive. Runbooks someone else can follow
- Cost and performance. YouTube analytics alone is 7,000+ videos × daily metrics × multiple channels. Partitioning, query tuning, and incremental processing at our scale, this work saves tens of thousands a year
- Data contracts. When a source violates its contract, your pipelines stop and alert rather than passing bad data to our downstream systems and AI
Requirements:
- 8–12+ years in data engineering, with at least 4 years primarily in Azure (Data Factory, Synapse, Fabric, Functions, ADLS, Azure Monitor, or comparable)
- Demonstrated ownership of a production data platform, not just a contributor to one. As the first dedicated data engineer here, you'll be the senior technical authority on data for several months before anyone else joins
- Strong SQL experience — query tuning, execution plans, indexing strategy, incremental models, data-quality validation. Not just 'can write a join.'
- Production-level C# and/or Python experience for custom connector work
- Solid experience with messy commerce/ERP APIs — ideally Amazon SP-API, NetSuite, or similar. This is non-negotiable. Stripe and Salesforce are not substitutes
- IaC and CI/CD discipline — Bicep, Terraform, or ARM, with dev/staging/prod separation, peer review, rollback thinking
- Demonstrated on-call experience — You've owned production incidents, been called at 2am, and written the runbooks so the next person didn't have to start from scratch
- Experience partnering with a technical executive without layers of management. You have the maturity to surface risks early and own your domain in a flat structure