Data Engineer

Latitude is hiring a Data Engineer to build and operate Google Cloud data pipelines for analytics and machine learning for a federal health customer. The role delivers curated BigQuery datasets and provides technical leadership on data engineering standards and practices.

Responsibilities:

• Build, maintain, and optimize batch and streaming data pipelines on Google Cloud that support analytics and machine learning
• Ingest data from APIs, databases, SaaS systems, streaming feeds, and files, then transform it and deliver curated datasets in BigQuery
• Build data quality rules, schema validation, and automated tests into pipelines, and monitor pipeline health with Cloud Monitoring and Cloud Logging
• Apply governance and security standards, including IAM, encryption, data masking, and auditing, and maintain pipeline infrastructure with Terraform and CI/CD
• Provide technical direction on data engineering standards, lead code reviews, and document datasets, transformations, and operating procedures

Requirements:

• Bachelor's degree in computer science, software engineering, information systems, data engineering, or a related technical field
• 3+ years of hands-on data engineering experience, including building production data pipelines on a cloud platform
• 3+ years leading technical teams, including setting technical standards and processes for cloud and on-premises environments and guiding technology decisions
• Hands-on experience with BigQuery, Cloud Storage, Dataflow, Dataproc, and Pub/Sub
• Strong SQL and Python, with experience in distributed data processing and data modeling
• Experience transforming large datasets and delivering ML-ready datasets for model training
• Ability to obtain and maintain a federal background investigation (Public Trust)
• Applicants need to be a US Citizen to be considered for the position
• Master's degree in a technical discipline
• Experience supporting federal government programs, especially federal health
• Knowledge of regulated environments: FedRAMP, HIPAA, NIST 800-53, CIS benchmarks
• Experience with Vertex AI or other ML platforms, and with feature store concepts
• Experience with Cloud Composer (Airflow), dbt, Dataplex, and Datastream for change data capture
• Experience with Apache Kafka or other streaming technologies, and with Looker or Looker Studio
• Security certification such as CISSP or CCSP