SourceDirect TalentRemote
Core Engineer - Data Systems
United States of America
Full-time
2 weeks ago
$130,000 - $185,000 USD
H1B Sponsored
Key skills
Data systems engineeringReal-time data pipelinesPythonGoStreaming systems (Kafka)Integration standardscommunicatorCross-functional collaborationOwnership mindsetAIAnalyticsKafka
About this role
SourceDirect Talent is seeking a Core Engineer focused on data systems to build the streaming and data foundations that power a next-generation edge platform. The role involves owning core platform capabilities for data ingestion, contextualization, and serving across various environments, while ensuring data accuracy and integration standards.
Responsibilities:
- Own core capabilities for ingesting, contextualizing, and serving data across edge and hybrid environments
- Build and evolve connectors and integration patterns across OT/IoT protocols and enterprise systems
- Implement and operate real-time streaming and event-driven data flows with clear failure modes
- Define and enforce data contracts, schemas, and integration standards
- Ensure end-to-end data accuracy, lineage, auditability, and validation
- Build and support internal data systems including:
- Observability pipelines
- Alerting systems
- Inventory and configuration databases
- Fleet telemetry
- Design scalable query and access patterns supporting analytics and AI workloads
- Partner with customer-facing teams to translate requirements into durable platform capabilities
- Produce clear engineering documentation and reusable artifacts
- Leverage AI tools to accelerate development while maintaining rigorous production review
Requirements:
- 6+ years building and operating production data, streaming, or integration systems
- Experience running real-time pipelines with strong reliability practices (e.g., Kafka-style systems, observability, on-call readiness, incident response)
- Strong engineering fundamentals with clean, well-documented implementations
- Proficiency in Python and/or Go, APIs for ingestion/access, and structured testing
- Comfortable navigating ambiguity and making sound trade-offs under real-world constraints
- Strong communicator and cross-functional collaborator
- Ownership mindset focused on outcomes
- Production experience with streaming and event-driven systems (e.g., Kafka)
- Experience with federated query systems and large-scale analytics access patterns (e.g., Trino)
- Background integrating data across OT/IoT environments (MQTT, OPC UA, Modbus, DNP3)
- Experience building trusted data systems with contracts, validation, and lineage
- Track record of turning complex customer integrations into repeatable platform capabilities