Senior Data Streaming Engineer
United States of America
Full-time
2 weeks ago
$106,000 - $149,000 USD
No H1B
Key skills
KafkaStriimData streamingOraclePostgreSQLAmazon RedshiftSnowflakeDistributed systemsAgile environmentsData qualityGovernanceSecurity considerationsProblem-solvingEffective communicationData EngineeringRedshiftAgileCommunication
About this role
PanAgora Asset Management is committed to transforming financial lives by providing a flexible work environment and promoting internal mobility. The Senior Engineer Data Streaming will design, build, and support real-time data streaming solutions, focusing on scalable and reliable streaming pipelines while collaborating with various stakeholders.
Responsibilities:
- Design, develop, and maintain end-to-end data streaming and CDC pipelines using Kafka and Striim
- Implement real-time data integration from source systems through streaming platforms to analytical and operational targets
- Collaborate with architects, lead engineers, and business partners to translate requirements into technical solutions
- Apply team best practices for Kafka topic design, partitioning, schema management, and Striim pipeline configuration
- Build reliable, scalable, fault-tolerant streaming solutions with attention to data consistency and replayability
- Perform code and configuration reviews and contribute to standards for testing, documentation, and deployment
- Troubleshoot and resolve complex production issues related to streaming pipelines, including latency and data correctness
- Participate in proof-of-concepts and evaluation of new streaming or data integration technologies
- Continuously improve observability, monitoring, and alerting for streaming pipelines
Requirements:
- Bachelor's degree in Computer Science or equivalent experience
- 5+ years of professional software or data engineering experience
- Strong hands-on experience with Kafka and Striim
- Experience integrating with Oracle, PostgreSQL, Amazon Redshift, and Snowflake
- Solid understanding of distributed systems, event-driven architectures, and CDC patterns
- Strong problem-solving, debugging, and analytical skills
- Effective communication skills and ability to collaborate across technical teams
- Experience working in Agile delivery environments
- Experience with Schema Registry and Avro/Protobuf/JSON schemas
- Exposure to cloud-native streaming services and containerized deployments
- Familiarity with data quality, governance, and security considerations for streaming data
- Prior experience supporting production systems with on-call or operational responsibilities