Acumenz Consulting is seeking a Data Engineer (Python) to design and maintain scalable data pipelines. The role involves optimizing data processes, collaborating with teams, and ensuring data quality across systems.
Responsibilities:
- Design, develop, and maintain scalable data pipelines using Python
- Build and optimize ETL/ELT processes for large-scale data processing
- Work with structured and unstructured data from multiple sources
- Develop and manage data workflows using tools like Airflow or similar schedulers
- Write efficient SQL queries and optimize database performance
- Collaborate with data analysts, scientists, and business teams to deliver data solutions
- Ensure data quality, integrity, and governance across systems
- Work with cloud platforms (AWS, Azure, or GCP) for data storage and processing
- Implement data security and compliance best practices
- Troubleshoot, debug, and enhance existing data systems and pipelines
Requirements:
- Atleast 10 years of experience
- DOB not more than 1991/92
- Design, develop, and maintain scalable data pipelines using Python
- Build and optimize ETL/ELT processes for large-scale data processing
- Work with structured and unstructured data from multiple sources
- Develop and manage data workflows using tools like Airflow or similar schedulers
- Write efficient SQL queries and optimize database performance
- Collaborate with data analysts, scientists, and business teams to deliver data solutions
- Ensure data quality, integrity, and governance across systems
- Work with cloud platforms (AWS, Azure, or GCP) for data storage and processing
- Implement data security and compliance best practices
- Troubleshoot, debug, and enhance existing data systems and pipelines