Together AIRemote
Senior Data Engineer
United States
Full Time
2 hours ago
$160,000 - $240,000 USD
H1B Sponsor Likely
Key skills
Stream processing pipelinesReal-time analytics systemsInfrastructure as CodeVersion control practicesGitOps workflowsProgramming languagesKubernetes experienceTypeScriptPythonJavaGolangRustAIArtificial IntelligenceAnalyticsKafkaApache KafkaAWSTerraformKubernetesGitHub ActionsPulumiArgoCDAWS CDKTeamCityKinesisGitHubGitOpsVersion ControlCI/CD
About this role
Together AI is a research-driven artificial intelligence company on a mission to significantly lower the cost of modern AI systems. They are seeking a Senior Data Engineer to define, build, and operate data infrastructure that handles millions of events daily, focusing on usage-based billing systems and real-time analytics products.
Responsibilities:
- Identify, design, and develop foundational data infrastructure components capable of handling millions or billions of events daily
- Analyze and improve the robustness and scalability of existing data processing infrastructure
- Partner with product teams to understand functional requirements and deliver solutions that meet business needs
- Write clear, well-tested, and maintainable infra-as-code and software for both new and existing systems
- Conduct design and code reviews, create developer documentation, and develop testing strategies for robustness and fault tolerance
- Participate in an on-call rotation to address critical incidents when necessary
Requirements:
- 5+ years of demonstrated experience in building large scale, fault tolerant, distributed data platforms, stream processing pipelines, ETLs, etc
- Expert-level skills in designing, building, and operating stream processing pipelines with services like AWS Kinesis, Apache Kafka, or Redpanda
- Expert-level knowledge of building real-time customer facing analytics systems using services like AWS TimeStream or Clickhouse
- Proficiency in writing and maintaining Infrastructure as Code (IaC) using tools like Terraform, AWS CDK, or Pulumi
- Proficiency in version control practices and integrating IaC with CI/CD pipelines
- Proficiency in implementing and managing GitOps workflows with tools such as ArgoCD, Github Actions, TeamCity, or similar
- Proficiency in one or more of Golang, Rust, Python, Java, or TypeScript
- Bachelor's or Master's degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience
- Experience with Kubernetes, or containers a plus