Senior Site Reliability Engineer

Entrust is a company that enables trusted identities, payments, and data protection globally. The Senior Site Reliability Engineer (SRE) will be responsible for ensuring the reliability, availability, and performance of the SaaS platform across multiple on-prem environments, focusing on operational excellence and scalability.

Responsibilities:

• Own SLOs/SLIs for availability (99.9%), latency, error rate, and quality of service across microservices
• Design/operate end‑to‑end observability: metrics, logs, traces, synthetic checks, real‑user monitoring (RUM)
• Instrument services (Windows services, APIs, background jobs) with structured logs and trace context
• Build health probes and SLA monitors for critical transactions and cross-service dependencies
• Monitor system issues using various metrics, such as uptime, latency, error rate, throughput, and availability
• Deploy and maintain monitoring and on-call tools i.e.: Splunk on-call, Prometheus, Datadog, etc
• Lead incident response (triage, comms, coordination, real-time mitigation) and conduct blameless postmortems with actionable follow-ups
• Maintain and continuously improve runbooks, escalation paths, on call rotations, and paging policies
• Implement MTTA/MTTR reduction programs
• Stand up war room protocols and ensure stakeholder updates during incidents
• Forecast compute, storage, network needs, track headroom against growth and peak patterns
• Conduct performance profiling and bottleneck analyses (CPU, memory, I/O, thread pools, connection pools)
• Optimize resource allocation on VMware (DRS, affinity rules, reservations) and Windows VM tuning (kernel, TCP stack, NICs)
• Validate scaling strategies (horizontal vs. vertical) and implement auto-scaling where supported
• Standardize gold images, configuration baselines, and desired state for Windows Server (PowerShell DSC or equivalent)
• Manage patching (OS, middleware, runtime) with maintenance windows aligned to error budgets
• Ensure backup, snapshot, and restore strategies meet RPO/RTO; regularly test restores
• Maintain secure baselines (CIS benchmarks for Windows/VMware), vulnerability management, and patch cadence
• Support compliance audits (PCI-CP, PCI-DSS, SOC 2/ISO 27001), produce evidence (configs, logs, access reviews), and remediate gaps
• Automate provisioning (VM templates, DSC/Ansible for Windows, Terraform for VMware) and configuration drift detection/correction
• Build runbooks to reduce toil (deploy, scale, rollback, etc)
• Create reliability guardrails (pre‑flight checks, change freeze rules, policy controls) as code
• Continuously refactor scripts/runbooks into idempotent automation
• Collaborate with development teams and other stakeholders to identify potential risks, such as security vulnerabilities, performance bottlenecks, deployment issues, or configuration errors
• Implement various risk mitigation strategies, such as patching, backup, redundancy, encryption, or testing
• Collaborate with product teams and other teams to understand the user needs, expectations, and satisfaction
• Coach engineers on SRE principles, incident handling, and reliability centric design
• Lead knowledge sharing, runbooks quality, and postmortem culture (blameless, action-oriented)
• Provide after-hours support for production issues on a rotational basis with other team members to ensure system availability 24/7/365

Requirements:

• 5+ years of experience in SRE, DevOps, or Software Engineering roles supporting distributed, production-grade environments, with strong skills in troubleshooting microservices, Windows/VMware systems, and on‑prem hybrid infrastructure
• Hands‑on experience with automation and observability, including Terraform/Ansible/DSC, CI/CD pipelines, logs/metrics/tracing systems, and enterprise monitoring tools such as Datadog, Prometheus, or Splunk
• Demonstrated capability with infrastructure automation tools (Terraform, Ansible, Jenkins, Octopus, PowerShell DSC, etc.)
• Proficiency in VMware, Windows Server administration, networking fundamentals, and system‑level performance analysis
• Hands‑on experience operating and troubleshooting enterprise microservices, APIs, and distributed application stacks in on‑prem/hybrid infrastructure
• Ability to provide after-hours production support on a rotational basis to ensure 24/7/365 system availability
• Demonstrated integrity and accountability, including reliability, ownership of mistakes, and commitment to high operational standards across compliance-sensitive environments (PCI‑DSS, PCI‑CP, SOC2)
• High self‑confidence, strong presentation and communication abilities, and a history of leading through example, helping establish a culture of operational excellence and continuous improvement
• Leadership behaviors, including initiative, thoughtful risk‑taking, reflective decision‑making, and the ability to take action confidently amid uncertainty