Key skills
Enterprise Data Platform EngineeringCloud-based Database ArchitectureMulti-cloud Database ArchitectureAWSAWS RDSAWS AuroraAWS EMRAWS ServerlessHBaseHiveSparkKafkaSolrPrivate Cloud Data PlatformsTerraformDevOps AutomationCI/CD PipelinesPythonData GovernanceRegulatory ComplianceGDPRHIPAASecurity Best PracticesContainerizationDockerKubernetesObservability ToolsPrometheusGrafanaCloudWatchSplunkDynatraceDatabase InsightsBusiness Continuity PlanningHigh-availability ArchitectureServerlessRDSCI/CD
About this role
Experian is a global data and technology company, powering opportunities for people and businesses around the world. They are seeking a Senior Data Platform Engineer to lead the design, implementation, and governance of complex database and BigData solutions that support large-scale, mission-critical business operations.
Responsibilities:
- Lead global teams in design and architecture discussions with partners, developers, and platform engineers
- Implement scalable and secure database architectures for enterprise systems across multi-availability-zone, multi-region cloud-native platforms (AWS, and private cloud)
- Optimize applications and databases to use the full capabilities and cost efficiencies of AWS cloud-native RDS & EMR platforms
- Review, configure, and maintain globally distributed data platforms that are available and scalable. Collaborate with IT, DevOps, and application teams to ensure seamless integration with existing systems
- Manage automated operations, deployments, patching, upgrades, and capacity planning through CI/CD pipelines and Infrastructure as Code (IaC) tools ensuring secure and scalable database operations across multi-cloud environments
- Monitor, troubleshoot, and fine-tune database performance to ensure scalability across multi-cloud environments
- Implement data protection strategies, including encryption and access controls. Support audit readiness and security reviews
- Manage regular maintenance windows to ensure system uptime
- Develop enterprise data models and enforce data standards, best practices, and governance frameworks to ensure data integrity and consistency
Requirements:
- Bachelor's degree in computer science, Information Systems, or a related field, or equivalent experience
- 7+ years of overall Enterprise Data Platform Engineering experience, with 5+ years focused on cloud-based open platform database architecture, design, and engineering
- Demonstrated expertise in multi-cloud database architecture, design, implementation, and cross-platform migration, grounded in core principles and best practices. This expertise spans across major platforms, including AWS and Private Cloud
- On AWS, expertise includes RDS Databases, Aurora, EMR, Serverless, HBase, Hive, Spark, Kafka, and Solr technologies. In Private Cloud, expertise involves Self-managed Data Platforms by Code
- Experience with Terraform and DevOps automation tools with expertise in CI/CD pipelines and best practices with Terraform and Python skills
- Familiarity with data governance and regulatory compliance frameworks (e.g., GDPR, HIPAA), along with security best practices
- Experience with containerization and orchestration tools such as Docker and Kubernetes
- Knowledge of observability and monitoring tools (e.g., Prometheus, Grafana, CloudWatch, Splunk, Dynatrace, and Database Insights)
- Experience with business continuity planning and high-availability architecture design