Design and implement robust data infrastructure in AWS, using Spark with Scala
Evolve our core data pipelines to efficiently scale for our massive growth
Store data in optimal engines and formats, matching your designs to our performance needs and cost factors
Collaborate with our cross-functional teams to design data solutions that meet business needs
Design and implement knowledge graphs, exposing their functionality both via Batch Processing and APIs
Leverage and optimize AWS resources while designing for scale
Collaborate closely with our Data Science and Product teams

Production data engineering experience
Proficiency in Spark and Scala
Experience in delivering significant technical initiatives and building reliable, large scale services
Experience in delivering APIs backed by relationship-heavy datasets
Familiarity with data lakes, cloud warehouses, and storage formats
Strong proficiency in AWS services
Expertise in SQL for data manipulation and extraction
Excellent written and verbal communication skills
Bachelor's degree in Computer Science or a related field
Demonstrated ability to use AI to improve speed and quality in your day-to-day workflow for relevant outputs
Strong track record of critical evaluation and verification of AI-assisted work
High integrity and ownership

Software Engineer II, Big Data

Key skills