Senior Data Engineer

Together AI is a research-driven artificial intelligence company. They are seeking a Senior Data Engineer to help define, build, and operate the data infrastructure for their mission-critical systems, focusing on scaling data processing components and real-time analytics products.

Responsibilities:

• Identify, design, and develop foundational data infrastructure components capable of handling millions or billions of events daily
• Analyze and improve the robustness and scalability of existing data processing infrastructure
• Partner with product teams to understand functional requirements and deliver solutions that meet business needs
• Write clear, well-tested, and maintainable infra-as-code and software for both new and existing systems
• Conduct design and code reviews, create developer documentation, and develop testing strategies for robustness and fault tolerance
• Participate in an on-call rotation to address critical incidents when necessary

Requirements:

• 5+ years of demonstrated experience in building large scale, fault tolerant, distributed data platforms, stream processing pipelines, ETLs, etc
• Expert-level skills in designing, building, and operating stream processing pipelines with services like AWS Kinesis, Apache Kafka, or Redpanda
• Expert-level knowledge of building real-time customer facing analytics systems using services like AWS TimeStream or Clickhouse
• Proficiency in writing and maintaining Infrastructure as Code (IaC) using tools like Terraform, AWS CDK, or Pulumi
• Proficiency in version control practices and integrating IaC with CI/CD pipelines
• Proficiency in implementing and managing GitOps workflows with tools such as ArgoCD, Github Actions, TeamCity, or similar
• Proficiency in one or more of Golang, Rust, Python, Java, or TypeScript
• Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience
• Experience with Kubernetes, or containers a plus