Design, develop, and maintain scalable data pipelines and ETL processes to collect, process, and store large volumes of data from various sources
Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions
Optimize and tune database queries and processes for performance and efficiency
Implement data quality checks and validation procedures to ensure the integrity and accuracy of data
Build and maintain data warehouses and data marts to support reporting and analytics needs
Work closely with data scientists and analysts to provide access to structured and unstructured data for analysis and modeling
Continuously evaluate and adopt new technologies and tools to enhance data processing capabilities and improve efficiency
Document technical designs, processes, and procedures for data engineering projects
Troubleshoot and resolve issues related to data pipelines, databases, and data infrastructure
Stay up-to-date with industry trends and best practices in data engineering and related technologies

Bachelor's degree in Computer Science, Engineering, or a related field
0-5 years of experience in data engineering or a similar role
Proficiency in SQL and experience working with relational databases (e.g., MySQL, PostgreSQL)
Strong programming skills in at least one scripting language (e.g., Python, Java, Scala)
Experience with data warehousing concepts and technologies (e.g., Snowflake, Redshift, BigQuery)
Familiarity with ETL tools and frameworks (e.g., Apache Airflow, Talend, Informatica)
Knowledge of cloud computing platforms and services (e.g., AWS, Azure, Google Cloud Platform)
Understanding of data modeling principles and techniques
Excellent problem-solving and analytical skills
Strong communication and collaboration skills, with the ability to work effectively in a team environment

Data Engineer

Key skills