Key skills
SparkHadoopJavaKubernetesInfrastructure as a productInnovationCommunication skillsProblem-solvingTeam collaborationAIMachine LearningAgileCommunication
About this role
HubSpot is an AI-powered customer platform seeking a Technical Lead II to join their Data Infrastructure—Batch Processing Team. The role involves leading a team to design and implement scalable backend services while collaborating with engineering teams to enhance data processing technologies.
Responsibilities:
- Lead a team of 3–5 engineers as a player-coach
- Design and implement scalable backend services, libraries, tools, and automation for data store operations and usage
- Collaborate with engineering teams to reliably integrate data processing technologies into their stack
- Support the uptime and reliability of database systems
- Work in a dynamic, agile environment to deliver comprehensive solutions that address user needs
- Conduct code reviews, contribute to internal tooling, and maintain high coding standards for application reliability and performance
- Coach the team to work iteratively, experiment with new ideas, and embrace a startup mentality of learning fast and adapting quickly
- Continuously learn and adapt to new technologies and frameworks to keep our solutions at the forefront of innovation
Requirements:
- Extensive experience in the Spark or Hadoop ecosystems and backend platform or infrastructure development, with proficiency in Java
- Experience delivering infrastructure platforms to other engineering teams and understands how to build infrastructure as a product
- A history of developing solutions that have had an outsized impact on organizational business goals
- Thrives in a collaborative environment, with strong communication skills and the ability to work effectively with teams across the organization
- Innovative and entrepreneurial, with a keen interest in staying ahead of technology trends, particularly in AI and machine learning
- Demonstrates strong ownership of projects end-to-end, with a track record of successfully rolling out infrastructure and collaborating with multiple engineering teams to deliver results
- Proven ability to solve complex technical problems and analyze trade-offs with empathy for developers
- Experience developing automation or power-user expertise with technologies such as Iceberg, Doris, Trino, and Flink
- Interest and experience actively supporting infrastructure at scale on Kubernetes
- Interest and experience contributing to open source software