Senior Data Pipeline Engineer (Elastic)

SERVISS delivers cybersecurity and IT solutions to government and commercial clients, including data pipeline and Elasticsearch platforms for cyber operations. The Senior Data Pipeline Engineer will lead data ingestion and pipeline engineering for the DHS CDM Data Services / BETSIE Program, integrating asset and cyber-intelligence data into Elasticsearch while setting technical direction, supporting data governance, and mentoring engineers.

Responsibilities:

• Architect, automate, and maintain scalable, fault-tolerant data processing pipelines that ingest asset, vulnerability, and configuration data from Armis, Axonius, and other SaaS/API sources into Elasticsearch
• Handle high-volume, high-velocity data collection, processing, and indexing to support near-real-time visibility
• Design Elasticsearch index strategies, mappings, ingest pipelines, and transforms; normalize disparate source data to a common schema (e.g., Elastic Common Schema) for consistent search, correlation, and reporting
• Build and maintain Kibana dashboards and visualizations that deliver a true single-pane-of-glass view of the agency's technical posture
• Own API integration patterns against evolving vendor APIs, including authentication and token management, pagination, rate limiting, incremental/delta ingestion, and resilient error handling and retry logic
• Implement automated reconciliation and data-quality checks to ensure ingested data is complete, consistent, and accurate against source systems; document and maintain data lineage and traceability of transformed data back to source
• Manage index lifecycle (ILM), retention, sharding, and cluster performance tuning for high-volume, low-latency operations
• Instrument pipelines with monitoring, alerting, and logging so data-flow issues are detected and resolved before they reach stakeholders
• Follow programming best practices, emphasizing code reusability and highly automated CI/CD pipelines for scalability
• Serve as a leading technical resource for the data ingestion and pipeline function on the DHS CDM Data Services / BETSIE Program
• Set technical direction and decompose large, complex problems into workable solutions across teams
• Establish and enforce data governance, validation, and documentation standards; review designs and mentor junior engineers on the team
• Serve as a liaison for the customer's data-improvement efforts, participating in regular meetings, representing the program, and supporting requirements gathering
• Communicate complex data and pipeline concepts to non-technical audiences, translating them into actionable recommendations

Requirements:

• US citizenship with the ability to obtain Public Trust Suitability
• Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field
• A minimum of six years of experience designing, implementing, and managing the technical delivery of large-scale data engineering or data pipeline services to diverse organizations
• 4+ years hands-on with Elasticsearch or OpenSearch: index design, mappings, ingest pipelines, query/aggregation, and cluster performance tuning
• Strong experience integrating REST APIs from SaaS platforms, including authentication, pagination, rate limiting, incremental ingestion, and resilient error handling
• Proficiency with a scripting/pipeline language and with ETL/ELT tooling such as Logstash, Elastic Agent/Beats, or equivalent
• Experience designing, implementing, and managing data schemas that comply with cyber-relevant data standards and frameworks, e.g., SCAP, STIX, OTEL, Elastic Common Schema, and Splunk Common Information Model
• Knowledge of data transformation processes and experience documenting and maintaining data lineage, especially traceability of transformed data to source data
• Solid data modeling and normalization skills for heterogeneous sources, including mapping to a common schema
• Knowledge of Federal Cybersecurity and Risk Management policies and practices, including FISMA; NIST SP 800-37, 800-53, 800-30, and 800-39; and FedRAMP
• Solid understanding of Git, version control workflows, and CI/CD
• Familiarity with Agile / SCRUM methodologies
• Strong problem-solving and analytical skills, with a sense of urgency and the ability to prioritize and balance multiple tasks
• master's degree
• Python
• Direct experience integrating Armis and/or Axonius, or comparable CAASM / asset-intelligence platforms (e.g., Tenable, Qualys, ServiceNow)
• Experience utilizing data cataloging and governance tools (e.g., Alation, Collibra)
• Containerization and orchestration (Docker, Kubernetes) and infrastructure-as-code (Terraform, Ansible)
• CI/CD tooling (GitLab CI, Jenkins) and DevSecOps practices in cloud (AWS GovCloud / Azure Government a plus)
• Experience with monitoring/observability tooling and data-reconciliation frameworks
• Knowledge of cybersecurity tools and technologies
• Active DHS Public Trust or prior EOD