Staff Software Engineer, Alerting Platform

Command|Link is a global SaaS platform providing network, voice services, and IT security solutions through a unified infrastructure platform. The Staff Software Engineer will architect and improve Command|Alert’s alerting and correlation engine, ensuring reliable processing and delivery of high-fidelity alerts while enabling LLM-driven troubleshooting and remediation. The role also provides cross-team technical leadership, mentorship, and architectural guidance across alerting-related teams.

Responsibilities:

• Set the architecture for how Command|Alert evaluates rule-based thresholds, ML anomaly scores, and correlation logic to produce high-fidelity alerts, across both global alerts we define and alerts customers define themselves
• Own the reliability of the alerting pipeline end to end: from OpenSearch alert evaluation through Kafka delivery via OpenSearch callbacks to downstream notification, including idempotency guarantees and soak-tested behavior under sustained load
• Drive the correlation strategy that turns diverse sources (security tooling, monitoring telemetry, syslog, OpenTelemetry, L2-L4 network protocols) into usable network and system topologies and their dependencies, and make that context usable for LLM reasoning over investigations and remediation
• Lay the technical groundwork for generating alert definitions from the normalized data model using LLMs
• Jump into any team or workstream across Command|Alert that needs architectural guidance, unblocking others and raising the bar on how the system is built
• Balance strategic bets (new correlation and detection capability) against the long-term foundation the alerting engine needs to hold up at scale
• Mentor engineers across the teams you touch, and represent Command|Alert's technical direction to stakeholders outside engineering
• Takes on additional responsibilities and projects as needed to support the success of the team and organization

Requirements:

• Demonstrated experience designing, building, or operating high-reliability alerting or notification systems in production, including running rule-based and ML-based detection logic against real traffic at scale
• Strong Kafka experience, particularly producing and consuming event streams for downstream delivery
• A working command of telemetry and protocol data: security tooling output, monitoring telemetry, syslog, OpenTelemetry, NetFlow or sFlow, SNMP, ICMP, and firewall logs, and the ability to turn that data into real network and system topologies and dependency maps
• A track record building or operating systems where webhook reliability, idempotency, and delivery guarantees under load are non-negotiable
• Recognized mastery of Go and/or Python, with range across container orchestration and a multi-cloud footprint
• A demonstrated ability to make org-level architecture and technology calls, not just execute within one
• Experience with Temporal or a comparable workflow orchestration platform
• Experience using LLMs to reason over structured system or network data for troubleshooting, remediation, or investigation workflows
• Familiarity with stream processing frameworks like Flink, Protocol Buffers for service contracts, or Argo and Spacelift for CI/CD and infrastructure as code
• Familiarity with Memgraph or another graph store for topology data
• Background with osquery, Steampipe, or similar endpoint and cloud inventory tooling
• Experience operating in a multi-tenant, cloud-native environment with secrets management and TLS at scale