Key skills
PythonFlaskDashDaskPandasAWS S3AWS IAMAWS SQSAWS LambdaAWS IRSATerraformSQLSnowflakeSnowflake external tablesSnowflake materialized viewsSnowflake performance tuningETL designParquetJSONCSVXMLZipped archivesLegacy system support.NETAIGenerative AIETLAnalyticsBDDAWSAzureGitLab CILambdaS3IAMSQSMongoDBAuth0DatadogGitLabCI/CD
About this role
KBRA Holdings, LLC is seeking a Lead Full-Stack Platform Engineer to enhance their KFI Data Platform. The role involves collaborating with teams to set technical vision, own architecture, and mentor engineers while working on financial data systems.
Responsibilities:
- Set and drive the technical vision for the team and partner with peer staff/principal engineers to shape direction across adjacent teams (data platform, reporting, internal and external frontends & apps)
- Sit at the table with product and business stakeholders (KBRA Analytics, Bank Product) to translate strategy into a multi-quarter technical roadmap, make build/buy/sunset calls, and own the architectural decisions that come out of them
- Own the architecture of a Snowflake lakehouse ingesting 30+ regulatory and market data sources (FFIEC, FDIC, NCUA, FactSet, Xignite, SEC EDGAR, FRED, etc.) via S3 external tables, Dask-based transforms, and SQS / Mongo change-stream event pipelines
- Design and evolve reusable Terraform modules spanning AWS, Azure, Snowflake, MongoDB Atlas, GitLab, Datadog, etc
- Drive CI/CD, IaC, and acceptance-test (BDD/behave) standards across the team
- Mentor engineers and act as code-owner across IaC, data-lake, and application repos
Requirements:
- Expert Python (ex/ Flask, Dash, Dask, Pandas)
- Deep experience with AWS (ex. S3, IAM, SQS, Lambda, IRSA)
- Terraform at module-author level
- Advanced SQL and Snowflake (ex. external tables, MVs, performance tuning)
- Experience designing high-throughput ETL over diverse formats (ex. Parquet, JSON, CSV, XML, zipped archives)
- Supporting legacy systems and responding to incidents
- .NET (for cross-team integrations)
- Azure compute/identity/queue services
- MongoDB Atlas
- Datadog APM
- Auth0
- GitLab CI at scale
- Familiarity with Generative AI tools such as ChatGPT for research, data insights, and general productivity