Prudent Technologies and Consulting, Inc. is seeking Senior Security Observability Engineers to build and operationalize observability capabilities across the SIEM ecosystem. The role involves leading efforts in designing integrated monitoring solutions and ensuring continuous visibility into system health for proactive fault detection and performance management.
Responsibilities:
- Design and build end-to-end telemetry and traceability for data events as they move across platforms, enabling real-time visibility into ingestion, transformation, routing, and storage processes
- Develop and maintain dashboards and alerting mechanisms to detect:
- Faults and failures (e.g., dropped messages, ingestion lags, retry loops)
- Latency or throughput bottlenecks across pipelines
- Schema mismatches or format errors
- Duplicate, delayed, or missing data
- Data quality anomalies at point of ingestion and final storage
Requirements:
- Experience in designing integrated monitoring solutions for tools like Cribl, Vector, Splunk, Snowflake, ADX, and Log Analytics
- Ability to leverage Grafana and PowerBI for dashboarding
- Experience in leading the architecture and implementation of a comprehensive observability strategy across the SIEM modernization ecosystem
- Knowledge of data pipeline layers (Cribl, Vector, NiFi), event transport (Event Hubs), intermediate storage (Blob), and multiple downstream platforms (Splunk, Snowflake, ADX, Log Analytics, Anvilogic)
- Experience in designing and building end-to-end telemetry and traceability for data events
- Ability to develop and maintain dashboards and alerting mechanisms to detect faults and failures, latency or throughput bottlenecks, schema mismatches or format errors, duplicate, delayed, or missing data, and data quality anomalies