CloudIngestRemote
Staff Software Engineer (Data)
United States of America
Contract
1 hour ago
$60 USD
H1B Sponsor Likely
Key skills
ScalaFunctional ProgrammingSQLGoogle Cloud PlatformPubsubDataflowBigQueryIDLThriftFinagleAIETLGCPGoogle Cloud
About this role
CloudIngest is seeking a Senior/Staff Software Engineer (Data) to act as the primary technical lead between CE Online and CE Offline teams. The role focuses on enhancing application logic and ecosystem stability through various key projects, including error table standardization and enabling local testing for CE services.
Responsibilities:
- Act as the primary technical lead between CE Online and CE Offline teams to execute on the below projects
- Adopt and enhance Error Table standardization AI skill to onboard all the remaining services, test and deploy to see through all the right errors ETL to Big Query
- Standardize all the values in the rawBQ error table and ensure the right set of fields get populated in the right set of columns
- Setup Data Quality alerting on the error table as well
- Enable Local Testing for all CE Services
Requirements:
- Senior Level (10+ years)
- Scala 2.x (Functional Programming experience)
- Hands on experience with SQL
- GCP / Google Cloud (Pubsub / Dataflow / Big Query)
- IDL / Thrift / Finagle knowledge / experience