We are looking for Markit EDM Developer for our client in Fort Mill, SC.
Job Title: Markit EDM Developer
Job Location: Fort Mill, SC
Job Type: Contract
Job Overview:
Pay Range: $55hr - $60hr
Requirement/Must Have:
- 5-10 years of experience in MDM with 5+ years in Markit EDM IHS.
- Strong expertise in Core Matcher design, data mastering pipelines, and Workflow/UI development.
- Hands-on experience with Kafka or equivalent streaming, AWS cloud services, and REST API development.
- Strong database experience across RDBMS and cloud data warehouses.
- Experience with CI/CD, Git, and Terraform.
- Proficiency in Python or Spark-based data processing.
Responsibilities:
- Lead design and development of enterprise MDM solutions on Markit EDM CADIS.
- Architect and implement Core Matcher frameworks, entity resolution, survivorship rules, and Golden Record creation and lifecycle management.
- Develop end-to-end data mastering pipelines including Data Constructors, Data Porters, Data Flows, and Rules Engines.
- Ensure scalability, reusability, and performance optimization.
- Design and develop Workflow UI components including WF Pages, WF Elements, and user-driven stewardship flows.
- Implement data governance workflows, approval, exception handling, and audit trails.
- Enable data lineage transparency and stewardship across domains, especially Party/Client.
- Implement real-time data processing and notifications using Apache Kafka and event-driven EDM triggers.
- Design near real-time mastering and synchronization patterns.
- Integrate EDM into enterprise event ecosystems.
- Develop and expose RESTful APIs using Data Generators and Process Launchers.
- Integrate with microservices architecture using Spring Boot, Java, and Node.js.
- Deploy and manage EDM solutions on AWS or Azure equivalent including AWS Glue, Lambda, S3, RDS, and eventing.
- Integrate EDM with modern data platforms such as Snowflake, Databricks, and Redshift.
- Design hybrid architecture for EDM golden source and Data Lake analytical layer.
- Work with Python, PySpark, and Spark SQL for data transformation, enrichment pipelines, and large-scale data processing.
- Handle ingestion from APIs, flat files, streaming feeds, and databases.
- Optimize large-volume batch and streaming pipelines.
- Build and maintain CI/CD pipelines for EDM using GitHub, GitLab, Octopus Deploy, Jenkins, and Azure DevOps.
- Use Infrastructure as Code (IaC) tools such as Terraform and CloudFormation.
- Implement automated deployments, environment promotion, and version control strategies.
- Work with Docker and Kubernetes for microservices deployment and integration layers around EDM.
- Enable scalable, resilient cloud-native deployments.
- Implement monitoring and logging using Splunk, ELK, Prometheus, Grafana, and CloudWatch.
- Perform performance tuning of matchers and batch jobs, and conduct root cause analysis and production support.
- Design and optimize databases across SQL Server, Oracle, PostgreSQL, and cloud-native warehouses.
- Develop complex SQL, stored procedures, and indexing and performance tuning strategies.
- Lead onsite-offshore model delivery and act as technical SME and solution architect for EDM.
- Collaborate with Business Analysts, Data Architects, and Scrum Teams.
- Conduct code reviews, design reviews, and release governance.
Nice to Have:
- Experience with Markit EDM Cloud 19x.
- Strong domain knowledge in Party, Client, and Instrument MDM.
- Experience with Databricks, Snowflake ecosystems, and microservices architecture using Spring Boot and Node.js.
- Experience with Kubernetes and containerization.
- Exposure to data governance frameworks such as Collibra and Alation.
Skills:
- Deep expertise in Markit EDM and modern data ecosystem.
- Strong architecture and system design mindset.
- Ability to lead complex data platform transformations.
- Excellent communication and stakeholder management.
- Strong problem-solving and performance optimization skills.