Role Summary:
The engineer will build, administer, secure, automate, and support the Cloudera CDP Public Cloud platform used by HMS Modernization, data ingestion, analytics, and Teradata migration workloads. This hands-on role covers CDP environments, Data Lakes, Data Hubs, CFM/NiFi, operating-system maintenance, security monitoring, upgrades, and application onboarding.
Key Responsibilities:
Provision and administer CDP Public Cloud environments, FreeIPA, Data Lakes, Data Hubs, CDE, CDW, and CFM/NiFi clusters.
Build and configure CFM 4.x and NiFi 2.x, including NiFi Registry, Schema Registry, Site-to-Site, repositories, queues, load balancing, and high availability.
Configure Ranger, RAZ, IDBroker, workload identities, S3 access, and prefix-level authorization.
Support Entra SAML/SSO, SCIM provisioning, CDP roles, groups, machine users, and application access.
Use CDP CLI, APIs, and automation scripts for provisioning, scaling, upgrades, maintenance, and operational support.
Configure Data Hub instance groups, storage, autoscaling, multi-AZ deployment, cluster databases, and recovery settings.
Develop, test, version, and maintain Cloudera Recipes for software installation, configuration, certificates, security agents, and operational automation.
Maintain Recipe lifecycle hooks, including pre-service deployment and post-Cloudera Manager startup activities.
Install and support approved security agents such as CrowdStrike and Nessus across CDP-managed EC2 nodes.
Monitor security-agent installation, registration, service health, scan coverage, and Install and support approved security agents such as CrowdStrike and Nessus across CDP-managed EC2 nodes.
Coordinate OS patch compatibility with CDP runtime, Cloudera Manager, Java, Python, parcels, and application dependencies.
Review vulnerability findings and remediate operating-system, Java, Cloudera, NiFi, and third-party package vulnerabilities.
Monitor cluster health, capacity, performance, service availability, disk utilization, certificates, licenses, and security events.
Configure and monitor Cloudera Manager alerts, audit logs, Ranger audits, NiFi bulletins, and integrations with enterprise monitoring platforms.
Maintain TLS certificates, trust stores, key stores, service credentials, and certificate-renewal procedures.
Onboard application teams and define isolated S3 paths, Ranger policies, NiFi process groups, workload access, and resource requirements.
Troubleshoot Cloudera Manager, FreeIPA, NiFi, Spark, Hive, Ranger, Kerberos, S3, KMS, DNS, certificates, and network-connectivity issues.
Plan and execute CDP runtime, CFM/NiFi, parcel, database, OS, Java, and security-agent upgrades.
Validate backups, restore procedures, cluster recovery, and disaster-recovery readiness.
Support Teradata migration and ingestion workflows involving on-premises HDFS, Linux filesystems, NiFi, AWS S3, and cloud data services.
Maintain platform standards, architecture documentation, onboarding guides, patching procedures, security runbooks, and recovery documentation.
Participate in production support, incident response, root-cause analysis, maintenance windows, and on-call rotations.
Required Experience:
5+ years supporting Cloudera, Hadoop, NiFi, or comparable enterprise data platforms.
Hands-on CDP Public Cloud administration and production support experience.
Strong experience with CFM/Apache NiFi, Ranger, RAZ, Cloudera Manager, Spark, Hive, FreeIPA, Kerberos, and IDBroker.
Experience creating and troubleshooting Cloudera Recipes and lifecycle scripts.
Strong RHEL/Linux administration experience, including patching, package management, systemd, storage, certificates, logs, and performance troubleshooting.
Experience with vulnerability remediation and endpoint security agents such as CrowdStrike, Nessus, or equivalent tools.
Experience with CDP CLI/API automation, Bash, Python, Git, and operational scripting.
Working knowledge of AWS S3, IAM roles, KMS, EC2, load balancers, private networking, and security groups.
Experience troubleshooting distributed systems, data flows, identity, certificates, DNS, and network connectivity.
Strong production support, documentation, change-management, and stakeholder communication skills.
Preferred:
Cloudera Public Cloud certification.
Experience with migration, AWS-based CDP deployments, multi-AZ architecture, and regulated workloads.
Familiarity with Terraform, GitHub CI/CD, Entra SAML/SCIM, CloudWatch, Splunk, ServiceNow, or comparable enterprise tools.
Experience with security hardening, compliance evidence, disaster recovery, and production-readiness reviews.
