Engineer- System Management

Tata Consultancy Services is seeking a System Administrator specializing in AWS EMR and Big Data management. The role involves designing, deploying, configuring, and maintaining big data environments on AWS, along with responsibilities in cluster administration, security compliance, automation, and collaboration with data engineers.

Responsibilities:

• Provision, configure, and manage Amazon EMR clusters
• Optimize sizing, auto-scaling, and performance
• Manage Hadoop components including HDFS, YARN, Hive, and Spark
• Install, configure, and upgrade big data tools
• Monitor cluster health and troubleshoot failures
• Manage data ingestion pipelines including Kafka, Kinesis, and AWS Glue
• Implement EMR security with IAM, Kerberos, KMS, and VPC configurations
• Ensure compliance with organizational standards
• Automate EMR provisioning using CloudFormation, CDK, or Terraform
• Build CI/CD pipelines using AWS tools or Jenkins
• Implement cost optimization strategies
• Use CloudWatch, CloudTrail, and EMR Console for diagnostics
• Tune Spark and Hive jobs for performance
• Work closely with data engineers and cloud teams
• On-call assistance

Requirements:

• Big Data Admin for AWS EMR (Elastic MapReduce) Big Data and Hadoop ecosystem
• Experience with Terraform, CloudFormation, and other DevOps tools
• Strong Linux administration and scripting (Bash, Python)
• Familiarity with AWS services like S3, EC2, IAM, CloudWatch
• Bachelor's Degree