Palantir Foundry Data Engineer

CGI Group, Inc. is seeking a Data Engineer with expertise in Palantir Foundry to design, build, and maintain data pipelines while implementing workflows and processing data. The role involves managing object relationships, optimizing ontologies, and ensuring data integration from multiple sources.

Responsibilities:

• Creating and managing Object Types, defining Link Types to establish object relationships, and developing Property Types to describe objects and link attributes
• Creating Interface Types for object polymorphism
• Ontology creation and maintenance using Foundry's Ontology Manager and leverage ontologies for data integration, analysis, and visualization
• Map business concepts and processes to ontological structures while optimizing these ontologies for performance and scalability
• Integrating data from multiple sources into Palantir Foundry, including ETL processes and data transformation
• Use Foundry's Code Workbooks to write and execute Python, PySpark, or SQL scripts for data processing
• Build, manage, and optimize data pipelines, including Batch, Incremental, and Streaming pipelines in Foundry for efficient data flow and processing
• Design complex data transformation logic within these pipelines, performance optimization of existing pipelines, data quality checks, error handling and setup pipeline schedules and triggers
• Develop back-end code logic leveraging semantic object linking (ontologies) within Foundry Pipeline Builder, Code Workbook, and Ontology Manager
• Ensure health of data connections and pipelines (utilizing filesystem, JDBC, SFTP, and webhook)

Requirements:

• Strong proficiency with Palantir Foundry, including experience with tools like Pipeline Builder, Code Workbooks, Ontology Manager, and Quiver
• Advanced skills in data engineering, particularly with PySpark, Python and SQL
• Experience designing and implementing complex ontologies within Palantir Foundry, including creating Object Types, Link Types, and Property Types
• Expertise in developing and managing data pipelines, including batch, incremental, and streaming pipelines
• Proficiency in semantic object linking and leveraging Foundry's semantic model for data transformation and enrichment
• Knowledge of data quality processes and the ability to implement testing and codification methods
• Understanding of program management principles and the ability to work in Agile/Scrum development teams
• Strong communication skills and the ability to collaborate with various stakeholders, including product owners and end-users
• BS/MS degree in Computer Science, Engineering, or a related field, or equivalent experience
• Certification in Palantir Foundry is strongly desired
• Experience in .Net, C#
• Experience in or exposure to designing data models that effectively utilize object linking to enable advanced analytics and AI/ML capabilities
• Develop front-end website architecture based on Palantir Foundry
• Design user interactions on web pages within Palantir Foundry Workshop
• Ensure responsiveness of web applications developed on low code/no code solutions
• Provide incident management, direct technical consulting and support for current applications/solutions
• Collaborate with various internal and external stakeholders/IT to timely report the status, updates and impediments
• Provides technical guidance for small to large enhancements in areas of solution alternatives, design, testing and documentation