Senior Data Engineer, Data Platform

TRM Labs is a company that provides blockchain analytics and AI solutions to help law enforcement and financial institutions combat crypto-related fraud. As a Senior Data Engineer on the Data Platform team, you will build reliable data services and develop complex ETL pipelines to support the analysis of blockchain transaction activity at a petabyte scale.

Responsibilities:

• Build highly reliable data services to integrate with dozens of blockchains
• Develop complex ETL pipelines that transform and process petabytes of structured and unstructured data in real-time
• Design and architect intricate data models for optimal storage and retrieval to support sub-second latency for querying blockchain data
• Oversee the deployment and monitoring of large database clusters with an unwavering focus on performance and high availability
• Collaborate across departments, partnering with data scientists, backend engineers, and product managers to design and implement novel data models that enhance TRM’s products

Requirements:

• A Bachelor's degree (or equivalent) in Computer Science or a related field
• A proven track record, with 5+ years of hands-on experience in architecting distributed system architecture, guiding projects from initial ideation through to successful production deployment
• Exceptional programming skills in Python, as well as adeptness in SQL or SparkSQL
• Versatility that spans the entire spectrum of data engineering in one or more of the following areas: In-depth experience with data stores such as Iceberg, Trino, BigQuery, and StarRocks, and Citus
• Proficiency in data pipeline and workflow orchestration tools like Airflow, DBT, etc
• Expertise in data processing technologies and streaming workflows including Spark, Kafka, and Flink
• Competence in deploying and monitoring infrastructure within public cloud platforms, utilizing tools such as Docker, Terraform, Kubernetes, and Datadog
• Proven ability in loading, querying, and transforming extensive datasets