Key skills
Data EngineeringETL workflowsData pipelinesCloud computingAWS servicesPythonPySparkMicroservices architectureDistributed systemsAI/ML tools and frameworksApache SparkKafkaSnowflakeDevOps practicesCI/CD pipelinesDockerKubernetesPalantir FoundryProblem solvingAIMLPyTorchTensorFlowETLAnalyticsRedshiftSparkAWSLambdaS3GlueAthenaPerformance OptimizationAgileCI/CD
About this role
EXL is a leading data analytics and digital operations and solutions company. They are seeking a Data Engineer to focus on ETL workflows, data pipelines, and cloud computing, utilizing AWS services and big data technologies to deliver complex data engineering solutions.
Responsibilities:
- 3+years of hands-on experience in data engineering with a focus on ETL workflows, data pipelines, and cloud computing
- Strong experience with AWS services for data processing and storage (e.g., S3, Glue, Athena, Lambda, Redshift)
- Proficiency in programming languages such as Python, PySpark
- Deep understanding of microservices architecture and distributed systems
- Familiarity with AI/ML tools and frameworks (e.g., TensorFlow, PyTorch) and their integration into data pipelines
- Experience with big data technologies like Apache Spark, Kafka, and Snowflake
- Strong problem-solving and performance optimization skills
- Exposure to modern DevOps practices, including CI/CD pipelines and container orchestration tools like Docker and Kubernetes
- Experience working in agile environments delivering complex data engineering solutions
- Proven expertise or certification in Palantir Foundry is highly preferred
Requirements:
- 3+ years of hands-on experience in data engineering with a focus on ETL workflows, data pipelines, and cloud computing
- Strong experience with AWS services for data processing and storage (e.g., S3, Glue, Athena, Lambda, Redshift)
- Proficiency in programming languages such as Python, PySpark
- Deep understanding of microservices architecture and distributed systems
- Familiarity with AI/ML tools and frameworks (e.g., TensorFlow, PyTorch) and their integration into data pipelines
- Experience with big data technologies like Apache Spark, Kafka, and Snowflake
- Strong problem-solving and performance optimization skills
- Exposure to modern DevOps practices, including CI/CD pipelines and container orchestration tools like Docker and Kubernetes
- Experience working in agile environments delivering complex data engineering solutions
- Bachelors Degree
- Proven expertise or certification in Palantir Foundry is highly preferred