Data Engineer

Intellect Group is a fast-growing, tech-driven company that is transforming how data is processed and analyzed. They are seeking a Python Data Engineer to design, build, and maintain scalable data pipelines while collaborating with data scientists and analysts to deliver high-quality data products.

Responsibilities:

• Design, build, and maintain scalable data pipelines to support analytics and business operations
• Work with large datasets using PySpark and Pandas for data processing and transformation
• Develop and optimize workflows using Airflow and DBT to ensure efficient data orchestration
• Manage and integrate data within Snowflake and Databricks environments
• Build reliable data solutions on AWS, ensuring performance, scalability, and security
• Collaborate with data scientists, analysts, and engineers to deliver high-quality data products
• Ensure data quality, integrity, and accessibility across systems
• Continuously improve data architecture and implement best practices across the data stack

Requirements:

• Strong experience working with Python for data engineering and processing
• Hands-on experience with PySpark and Pandas
• Proven experience with Snowflake, Databricks, Airflow, and DBT
• Experience working within AWS cloud environments
• Strong understanding of data modeling, ETL/ELT processes, and pipeline optimization
• Experience working with large-scale datasets in production environments
• Strong problem-solving skills and attention to detail
• Ability to work independently in a fully remote setting
• Experience working in a data-heavy or analytics-driven company
• Familiarity with real-time or streaming data pipelines
• Exposure to modern data architecture patterns and best practices
• Experience collaborating in fast-paced or startup environments