Data Engineer

DashLabs LLC is a dynamic EdTech firm at the forefront of innovation in education. They are seeking a talented and motivated Data Engineer to play a vital role in their expanding team, collaborating with various professionals to design and implement data pipelines for AI-driven projects.

Responsibilities:

• Collaborate closely with cross-functional teams, including AI Research Scientists, Data Scientists, and Machine Learning Engineers, to design and implement robust data pipelines for AI-driven projects
• Collect, clean, and preprocess data from various sources, ensuring its quality, integrity, and compatibility with downstream processes
• Develop and maintain scalable and efficient data processing solutions that support analytics, modeling, and visualization needs
• Implement data transformation and integration processes, ensuring smooth data flow and accessibility for different stakeholders
• Optimize database systems for performance, ensuring quick and reliable access to large volumes of data
• Collaborate with Machine Learning Engineers to deploy machine learning models into production environments, ensuring data availability and model performance
• Stay updated with emerging trends in data engineering and technology, bringing new ideas and solutions to the team
• Document data engineering processes, data flows, and system architecture for reference and knowledge sharing

Requirements:

• Proven experience as a Data Engineer, working on data pipelines, ETL processes, and data warehousing
• Proficiency in programming languages such as Python, Java, or Scala, and experience with relevant frameworks
• Strong knowledge of SQL and database systems, with expertise in data modeling, schema design, and query optimization
• Experience with data integration and transformation tools, such as Apache Spark, Apache Kafka, or similar technologies
• Familiarity with cloud platforms such as AWS, Azure, or GCP, and knowledge of containerization and orchestration tools like Docker and Kubernetes
• Solid understanding of data security, privacy, and compliance considerations
• Excellent problem-solving skills and attention to detail
• Strong communication and collaboration skills, with the ability to work effectively in a multidisciplinary team environment
• Bachelor's or Master's degree in Computer Science, Data Science, or a related field
• 7 years of experience