Software Engineer (L3) Data Substrate

Twilio provides real-time business communications and data solutions that help companies and developers build applications and customer experiences. The Senior Software Engineer will design, build, and optimize scalable data infrastructure, systems, and frameworks for Twilio’s Data Platform and data lakes. The role also involves cross-functional collaboration, ensuring data quality and security, and mentoring early-career engineers.

Responsibilities:

• Design, build, and maintain infrastructure and scalable frameworks to support data ingestion, processing, and analysis
• Collaborate closely with cross-functional teams to understand business requirements and translate them into scalable and efficient technical solutions
• Architect and implement high-performance data systems, distributed storage solutions, and processing frameworks using modern technologies
• Design and implement frameworks and solutions for performance and reliability
• Ensure data quality, integrity, and security throughout the data lifecycle, adhering to industry best practices and compliance standards
• Stay current with emerging technologies and best practices in big data technologies
• Mentor early in career engineers and contribute to a culture of continuous learning and improvement

Requirements:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field
• 5+ years of experience in  software development or a related field
• Proven track record of architecting and delivering complex data projects at scale, with a deep understanding of data infrastructure and distributed systems
• Strong proficiency in programming languages such as Python, Java, Go, or Scala
• Strong experience working with big data technologies such as Spark, Kafka, Athena, ClickHouse, DynamoDB, and distributed computing systems
• Strong experience with building data streaming pipelines and working with REST APIs
• Strong experience with AWS technologies at scale and using that to build and operate large scale systems
• Solid understanding of software engineering principles, including object-oriented and functional programming paradigms, design patterns, and code quality practices
• Excellent problem-solving and analytical skills
• Strong verbal & written communication skills, with the ability to work effectively in a cross-functional team environment
• Demonstrated ability to thrive in a fast-paced, dynamic environment and deliver results
• This role will be remote, and based in the United States. This role will be remote but is not eligible to be hired in San Francisco, CA, Oakland, CA, San Jose, CA, or the surrounding areas
• For this role, you may be required to travel occasionally to participate in project or team in-person meetings
• Bias to action, ability to iterate and ship rapidly
• Passion to build data products, prior projects in this area
• Experience building and working with data lake products