Key skills
AWSAzureCloudHadoopPySparkSparkData EngineeringGoogle CloudGitCI/CD
About this role
Role Overview
- Utilize advanced analytical techniques to extract insights from large datasets
- Support clients in solving complex business problems
- Build and manage data processing pipelines
- Design and develop data pipelines from ingestion to consumption
- Collaborate with cross-functional teams to deliver solutions
Requirements
- 4+ years of experience in data engineering or architecture
- Experience in using Azure, AWS, or Google Cloud services
- 4+ years of experience in design and development of large scale data solutions
- Proficiency in big data technologies like Spark, PySpark, and Hadoop
- Experience with database management, migration and transformation
- Experience in development using message queues and stream processing
- Experience with Git and CI/CD pipelines
Tech Stack
- AWS
- Azure
- Cloud
- Hadoop
- PySpark
- Spark
Benefits
- Competitive compensation
- Health insurance
- Professional development opportunities
- Flexible work arrangements
- Opportunities for variable incentive pay programs