Key skills
PythonPySparkSpark SQLSQLPalantir FoundryData validationData quality frameworksCompliance reportingAudit reportingRegulatory reportingSpark
About this role
AMISEQ is seeking a Senior Data Engineer to support OEIS compliance reporting by building auditable, Foundry native data pipelines and data checker frameworks. The engineer will be responsible for compliance transformations, validation logic, and traceable outputs that meet regulatory and audit requirements.
Responsibilities:
- Design and maintain Palantir Foundry pipelines for OEIS compliance reporting
- Build and maintain data checker/validation frameworks within Foundry
- Develop PySpark and Spark SQL transformations for large scale datasets
- Implement compliance driven checks (completeness, consistency, reconciliation, exception flags)
- Ensure full data lineage, auditability, and reproducibility of compliance datasets
- Partner with compliance SMEs and stakeholders to validate logic and reporting outputs
- Support operational monitoring, issue triage, and data quality remediation
Requirements:
- Strong Python
- PySpark / Spark SQL
- Advanced SQL
- Hands on experience with Palantir Foundry
- Experience building data validation, QA, or data quality frameworks
- Understanding of compliance, audit, or regulatory reporting requirements