Onsite role Urgent client needs Kafka Administrator
Kafka Administrator supporting (MSK, Kraft)
St. Louis, Missouri or Denver, Colorado - Onsite
6 Months Contract
JD:
We are seeking an experienced Senior Big Data / Hadoop / Kafka / DevOps Administrator to manage, support, automate, and optimize enterprise-scale Hadoop, Kafka, AWS Cloud, and DevOps platforms.
This role is responsible for ensuring the availability, performance, security, scalability, and operational excellence of critical data platforms while partnering closely with Data Engineering, Architecture, Infrastructure, Security, and Business teams.
Key Responsibilities
Kafka Administration
Deploy, configure, administer, and support Apache Kafka clusters and AWS Managed Streaming for Kafka (MSK) environments.
MSK and Kraft experience even if they have knowledge in Agentic AI that is fine.
Monitor cluster health, broker performance, consumer lag, partition distribution, and replication status.
Perform capacity planning, cluster expansion, and performance tuning activities.
Implement and maintain Kafka security using SSL, SASL, ACLs, encryption, and authentication mechanisms.
Troubleshoot and resolve producer, consumer, broker, and networking issues.
Manage and support Kafka Connect, Schema Registry, Mirror Maker, Cruise Control, and related ecosystem components.
Ensure high availability, disaster recovery, and platform resiliency.
AWS Cloud Administration:
Manage and support AWS services including: EC2, S3, IAM, VPC, EBS, CloudWatch, CloudTrail, AWS Glue
Related services
Administer AWS MSK, EMR, Lambda, Airflow, and data platform infrastructure.
Implement cloud security best practices, governance controls, and compliance standards.
Provision and manage infrastructure using Infrastructure-as-Code (IaC) methodologies.
Monitor cloud resource utilization, optimize performance, and control operational costs.
Support cloud migration, modernization, and automation initiatives.
DevOps & Automation:
Design, develop, and maintain CI/CD pipelines using Jenkins, GitHub Actions, GitLab CI/CD, or similar tools.
Automate infrastructure provisioning and configuration using Terraform, CloudFormation, and Ansible.
Manage source code repositories, release processes, and deployment workflows.
Implement proactive monitoring, logging, and alerting solutions using Prometheus, Grafana, Splunk, ELK, and CloudWatch.
Support containerized environments using Docker and Kubernetes.
Develop and maintain automation scripts and operational tooling using Python, Shell, and Bash scripting.
Operations & Support:
Provide Level 2 and Level 3 production support for critical data platform environments.
Participate in on-call rotations, incident response, and problem management activities.
Conduct Root Cause Analysis (RCA) and implement corrective and preventive actions.
Create and maintain operational documentation, runbooks, and standard operating procedures.
Ensure compliance with security, audit, regulatory, and organizational standards.
Collaborate with cross-functional teams to support enterprise data engineering, analytics, and AI/ML initiatives.
Required Skills:
Apache Kafka Administration
Hadoop Ecosystem Administration
AWS Cloud Services: EC2, S3, VPC, IAM, CloudWatch, EMR, Glue, MSK
Linux Administration (RHEL, Rocky Linux, CentOS, Ubuntu)
Python, Shell, and Bash scripting
Jenkins, Git, GitLab, GitHub Actions
Terraform, CloudFormation, Ansible
Docker and Kubernetes
Monitoring & Observability tools: Grafana, Prometheus, Splunk, ELK
Networking fundamentals, security, and high-availability architecture
Capacity planning, performance tuning, and troubleshooting
Preferred Qualifications:
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
Experience with Cloudera CDP, Hortonworks, or other Hadoop distributions.
Hands-on experience with AWS MSK, Apache Airflow, Apache Spark, and Databricks.
AWS, Kafka, Kubernetes, Terraform, or Cloud certifications.
Experience supporting large-scale production environments handling terabyte- to petabyte-scale workloads.
Best regards,
Alvin Stuart - Lead IT Recruiter
Direct Number:
Email:
