Principal Software Engineer

Twilio is shaping the future of communications and is seeking a Principal Software Engineer for their Data Substrate team. The role involves leading the design and development of scalable data solutions, driving technical innovation, and mentoring engineers.

Responsibilities:

• Lead the design and development of our data infrastructure, driving technical vision and strategy to ensure scalability, reliability, and performance
• Serve as the subject matter expert in distributed systems, data technologies, with strong software engineering skills
• Architect and implement scalable and efficient data systems, storage solutions, and processing frameworks using state-of-the-art technologies
• Drive technical innovation and research to stay at the forefront of emerging data technologies and best practices
• Mentor and coach a team of talented engineers, fostering a culture of technical excellence, collaboration, and continuous learning
• Collaborate closely with cross-functional teams to understand business requirements and translate them into scalable and efficient technical solutions
• Ensure data quality, integrity, and security throughout the data lifecycle, adhering to industry best practices and compliance standards

Requirements:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• 10+ years of experience in software development, or a related field, with at least 5 years in a technical leadership role
• Proven track record of architecting, delivering, and driving technical strategy of large-scale data platforms, especially utilizing cloud computing systems like AWS and deploying via K8s/Terraform/Helm
• Expertise in big data technologies such as Clickhouse, Kafka, Spark and deep understanding of how partitioning, slicing and dicing big data works
• Proficiency in programming languages such as Python, Java, Bash, Go, with strong problem-solving skills and attention to detail
• Excellent communication and collaboration skills, with the ability to influence technical decisions and drive alignment across teams
• Track record of elevating engineering standards, mentoring across teams, and influencing organizational technical decisions, not just at the squad level
• Deep commitment to operational excellence, with demonstrated experience in architecting for high availability, observability, and incident response in distributed systems
• Demonstrated ability to thrive in a fast-paced, dynamic environment and deliver results under tight timelines
• Knowledge of tying into various authorization/authentication systems
• Networking and network security knowledge
• Deep expertise in Clickhouse: demonstrated experience in architecting, tuning, and operating Clickhouse at scale