Senior Data Engineer

This Jobot Consulting Job is hosted by: Andrew Nguyen
Are you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume.
Salary: $50 - $70 per hour

A bit about us:

We are seeking a Senior Data Engineer to lead the end-to-end migration of complex structured finance datasets from a legacy proprietary platform to Databricks.

This is a highly autonomous, architecture-focused role. The ideal candidate will own data architecture and modeling decisions from the ground up, including how complex financial instruments and their time-series behavior are represented, while designing and implementing the ingestion, transformation, validation, and publishing layers required for migration.

A significant portion of the legacy platform's business logic exists within a large, sparsely documented codebase. The successful candidate will be comfortable reverse-engineering legacy systems, translating undocumented business rules into modern data models, validating strict financial parity, and optimizing cloud infrastructure for performance and cost.

Why join us?

• 50-70/hr!
• Renewable 6 Month Contract!

Job Details

Responsibilities

• Lead migration of structured finance datasets from a legacy platform to Databricks.
• Reverse-engineer undocumented business logic and establish data/financial parity.
• Design data models supporting time-series data, point-in-time accuracy, bitemporal history, and late-arriving data.
• Build scalable ingestion, transformation, and publishing pipelines.
• Optimize Spark/Databricks performance, storage, orchestration, and cloud costs.
• Partner with quantitative, risk, and product teams and document architectural decisions.

Required Qualifications

• 8+ years of Data Engineering experience with architectural ownership.
• Strong production experience with Databricks, Delta Lake, Spark/PySpark, Spark SQL, and Unity Catalog.
• Strong knowledge of financial/structured finance data, including ABS/MBS, loan-level data, cash flows, and financial time series.
• Experience reverse-engineering large, undocumented legacy codebases using SQL, C++, Java, or similar.
• Advanced Python and SQL skills.
• Experience with CI/CD, Git, Terraform, and cloud data platforms.

Preferred

• Experience fully migrating and decommissioning legacy platforms.
• Experience with Delta Live Tables, data governance, and FinOps.
• Conference presentations or published technical work in data engineering or financial technology.

Engagement

• 6-month contract, with potential extension.
• Remote within the U.S.
• NYC-area candidates strongly preferred for periodic onsite collaboration.
• Must be available during U.S. Eastern Time business hours.
• Must be authorized to work in the U.S. for the duration of the engagement.

Interested in hearing more? Easy Apply now by clicking the "Apply Now" button.

Jobot is an Equal Opportunity Employer. We provide an inclusive work environment that celebrates diversity and all qualified candidates receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity, religion, national origin, age (40 and over), disability, military status, genetic information or any other basis protected by applicable federal, state, or local laws. Jobot also prohibits harassment of applicants or employees based on any of these protected categories. It is Jobot's policy to comply with all applicable federal, state and local laws respecting consideration of unemployment status in making hiring decisions.

Sometimes Jobot is required to perform background checks with your authorization. Jobot will consider qualified candidates with criminal histories in a manner consistent with any applicable federal, state, or local law regarding criminal backgrounds, including but not limited to the Los Angeles Fair Chance Initiative for Hiring and the San Francisco Fair Chance Ordinance.

Information collected and processed as part of your Jobot candidate profile, and any job applications, resumes, or other information you choose to submit is subject to Jobot's Privacy Policy, as well as the Jobot California Worker Privacy Notice and Jobot Notice Regarding Automated Employment Decision Tools which are available at jobot.com/legal.

By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Jobot, and/or its agents and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here: jobot.com/privacy-policy