Lightcast is a global leader in labor market insights, headquartered in Moscow, ID. They are seeking a Data Engineer responsible for building and maintaining systems that improve data reliability, quality, and accessibility, focusing on developing software and data pipelines for ETL processes.
Responsibilities:
- Collect, manage, and transform large-scale raw data from multiple sources into structured, reliable, and usable formats that meet business and analytical requirements
- Design, develop, and maintain data architectures, pipelines, and applications using appropriate tools and frameworks to support scalable data processing and product development
- Build and maintain robust extract, transform, and load (ETL) processes that ensure data accuracy, efficiency, and availability across systems
- Perform root cause analysis to identify data issues, system inefficiencies, or process gaps, and implement improvements that enhance data quality and operational performance
- Work in an agile Scrum environment by contributing to sprint planning, development tasks, testing, and sprint reviews to deliver reliable and scalable data solutions
Requirements:
- Bachelor's in Computer Science, Mathematics, Statistics, or related field (or equivalent experience)
- 2+ years in data engineering, data analysis, or similar roles
- Experience with ETL, data warehousing, and scalable data systems
- Solid understanding of statistical methods and data analysis
- Strong communication skills with ability to work independently and in teams
- Proficiency in Python and SQL; familiarity with Java, C/C++, or similar
- Strong software engineering, programming, and QA skills
- Experience with Linux/Unix (POSIX systems) and Git
- Experience with Docker, Terraform, and AWS (Batch, EMR/Spark, ecosystem tools)
- Familiarity with GitLab and Scala