Intellect Group is a fast-growing, tech-driven company that is transforming how data is processed and analyzed. They are seeking a Python Data Engineer to design, build, and maintain scalable data pipelines while collaborating with data scientists and analysts to deliver high-quality data products.
Responsibilities:
- Design, build, and maintain scalable data pipelines to support analytics and business operations
- Work with large datasets using PySpark and Pandas for data processing and transformation
- Develop and optimize workflows using Airflow and DBT to ensure efficient data orchestration
- Manage and integrate data within Snowflake and Databricks environments
- Build reliable data solutions on AWS, ensuring performance, scalability, and security
- Collaborate with data scientists, analysts, and engineers to deliver high-quality data products
- Ensure data quality, integrity, and accessibility across systems
- Continuously improve data architecture and implement best practices across the data stack
Requirements:
- Strong experience working with Python for data engineering and processing
- Hands-on experience with PySpark and Pandas
- Proven experience with Snowflake, Databricks, Airflow, and DBT
- Experience working within AWS cloud environments
- Strong understanding of data modeling, ETL/ELT processes, and pipeline optimization
- Experience working with large-scale datasets in production environments
- Strong problem-solving skills and attention to detail
- Ability to work independently in a fully remote setting
- Experience working in a data-heavy or analytics-driven company
- Familiarity with real-time or streaming data pipelines
- Exposure to modern data architecture patterns and best practices
- Experience collaborating in fast-paced or startup environments