Data Engineer I

Flashpoint is the pioneering leader in threat data and intelligence. They are seeking a Data Engineer I to manage real-time data infrastructure and ensure the operational integrity of their intelligence platform, focusing on maintaining and optimizing data pipelines.

Responsibilities:

• Own end-to-end operations of real-time pipelines that ingest, enrich, filter, and route data through Vertex AI and Gemini for risk assessment
• Own our Pub/Sub infrastructure end to end: message delivery, consumer groups, and the production incident response when something goes sideways
• Scale, monitor, and optimize Dataflow streaming and batch jobs processing petabytes of data, diagnosing failures and shipping the fix
• Build and maintain the monitoring, alerting, and incident-response tooling for systems that can't go down
• Safeguard data integrity end to end, ensuring data reaches customers accurately and on time
• Partner with Product, the broader Data team, and Intelligence Analysts to turn requirements into operational reality

Requirements:

• Hands-on production experience building or operating streaming data pipelines (Pub/Sub, Kafka, or similar)
• Demonstrated ability to debug and optimize GCP Dataflow (or comparable Beam-based stream processing)
• A reliability mindset, fluency with SLAs, observability, on-call, and incident response, and the autonomy to dive into logs, metrics, and traces unaided
• Proficiency with Python, SQL, and Linux
• Real experience integrating Vertex AI / Gemini, or strong transferable experience with similar LLM platforms, into data workflows
• BigQuery
• BigTable
• Cloud Storage
• Cloud Functions
• Terraform
• data quality / validation frameworks
• threat intelligence or security data workflows
• experience on small, senior teams