Trilyon, Inc. is seeking a Senior / Lead Data Engineer to drive high-impact data engineering and compliance reporting initiatives in a fast-paced, data-driven environment. The role involves leading the design and development of data pipelines, ensuring data quality and compliance, and partnering with stakeholders to define reporting logic.
Responsibilities:
- Lead design & development of Palantir Foundry pipelines
- Architect scalable PySpark / Spark SQL transformations
- Build robust data validation & quality frameworks
- Ensure data lineage, auditability & compliance readiness
- Partner with stakeholders & compliance teams to define logic and reporting
Requirements:
- Strong experience in Python, PySpark, Spark SQL
- Hands-on expertise with Palantir Foundry
- Proven experience building data quality / validation frameworks
- Strong understanding of compliance / regulatory reporting
- Ability to lead initiatives & mentor junior engineers
- Utility / Energy domain experience
- Foundry Workshop
- Experience with ontology-driven datasets