Key skills
AirflowAmazon RedshiftAWSETLHadoopPySparkPythonSparkSQLTableauBIBusiness IntelligencePower BIRedshiftS3GlueRemote Work
About this role
Role Overview
- Design and implement scalable data pipelines using Python, PySpark, and Big Data tools
- Optimize data processing performance in AWS
- Collaborate with business teams to deliver reliable data solutions
- Develop and maintain ETL processes using tools like Airflow, Azkaban, and AWS Glue
- Troubleshoot and ensure data integrity across data pipelines
- Mentor junior team members and promote best practices
Requirements
- 5+ years of experience in Data Integration
- Strong experience with Python, PySpark, SQL, AWS (Redshift, Glue, S3)
- Expertise in big data technologies (Hadoop, Hive, Spark)
- Proficient in data modeling and ETL orchestration
- Experience with business intelligence tools (Tableau, Power BI)
Tech Stack
- Airflow
- Amazon Redshift
- AWS
- ETL
- Hadoop
- PySpark
- Python
- Spark
- SQL
- Tableau
Benefits
- Professional development
- Remote work options