EverestDX Inc is a Digital Platform Services company based in Stamford, specializing in digital transformation solutions. They are seeking a Data Engineer to design, develop, and maintain scalable data pipelines, ensuring data quality and collaborating with cross-functional teams to meet analytical needs.
Responsibilities:
- Design, develop, and maintain scalable data pipelines using Python, SQL, and PySpark
- Build and optimize ETL/ELT workflows for ingesting data from multiple sources
- Transform raw data into curated datasets suitable for analytics and reporting
- Develop and maintain data models to support business intelligence and analytical needs
- Monitor, troubleshoot, and optimize data workflows for performance and reliability
- Ensure data quality, consistency, and integrity across systems
- Collaborate with data analysts, data scientists, and cross-functional teams to understand data requirements
- Implement best practices for data engineering, including logging, monitoring, and documentation
- Support deployment and maintenance of data solutions in cloud or on-prem environments
Requirements:
- 2–4 years of hands-on experience in Data Engineering or related roles
- Strong proficiency in SQL for complex queries, performance tuning, and data transformation
- Solid programming experience in Python for data processing, scripting, and automation
- Practical experience with PySpark for large-scale data processing and distributed computing
- Good understanding of data warehousing concepts, ETL/ELT processes, and data modeling techniques
- Experience working with structured and semi-structured data (JSON, CSV, Parquet, etc.)
- Knowledge of big data ecosystems and distributed data processing frameworks
- Familiarity with version control systems (e.g., Git) and CI/CD practices is a plus
- Understanding of data quality, validation, and governance best practices
- Strong problem-solving skills and ability to work in an agile development environment
- Bachelor's degree in computer science, Information Technology or a related field
- Equivalent work experience may be considered in place of formal education