Senior Data Engineer (Palantir Foundry)

VLink Inc is a rapidly growing digital technology services and consulting company. They are seeking a Senior Data Engineer to design, build, and maintain data pipelines, implement workflows, and integrate data using Palantir Foundry.

Responsibilities:

• Creating and managing Object Types, defining Link Types to establish object relationships, and developing Property Types to describe objects and link attributes
• Creating Interface Types for object polymorphism
• Ontology creation and maintenance using Foundry's Ontology Manager and leverage ontologies for data integration, analysis, and visualization
• Map business concepts and processes to ontological structures while optimizing these ontologies for performance and scalability
• Data Integration: Integrating data from multiple sources into Palantir Foundry, including ETL processes and data transformation
• Code Workbooks: Use Foundry's Code Workbooks to write and execute Python, PySpark, or SQL scripts for data processing
• Pipeline Management: Build, manage, and optimize data pipelines, including Batch, Incremental, and Streaming pipelines in Foundry for efficient data flow and processing. Design complex data transformation logic within these pipelines, performance optimization of existing pipelines, data quality checks, error handling and setup pipeline schedules and triggers
• Semantic Object Linking: Develop back-end code logic leveraging semantic object linking (ontologies) within Foundry Pipeline Builder, Code Workbook, and Ontology Manager. Facilitate data transformation and enrichment processes
• Data Connection Maintenance: Ensure health of data connections and pipelines (utilizing filesystem, JDBC, SFTP, and webhook)

Requirements:

• Strong proficiency with Palantir Foundry, including experience with tools like Pipeline Builder, Code Workbooks, Ontology Manager, and Quiver
• Advanced skills in data engineering, particularly with PySpark, Python and SQL
• Experience designing and implementing complex ontologies within Palantir Foundry, including creating Object Types, Link Types, and Property Types
• Expertise in developing and managing data pipelines, including batch, incremental, and streaming pipelines
• Proficiency in semantic object linking and leveraging Foundry's semantic model for data transformation and enrichment
• Knowledge of data quality processes and the ability to implement testing and codification methods
• Understanding of program management principles and the ability to work in Agile/Scrum development teams
• Strong communication skills and the ability to collaborate with various stakeholders, including product owners and end-users
• BS/MS degree in Computer Science, Engineering, or a related field, or equivalent experience
• Certification in Palantir Foundry is strongly desired
• Experience in .Net, C#
• Experience in or exposure to designing data models that effectively utilize object linking to enable advanced analytics and AI/ML capabilities
• Develop front-end website architecture based on Palantir Foundry
• Design user interactions on web pages within Palantir Foundry Workshop
• Ensure responsiveness of web applications developed on low code/no code solutions
• Provide incident management, direct technical consulting, and support for current applications/solutions
• Collaborate with various internal and external stakeholders/IT to timely report the status, updates, and impediments