Data Engineer - Clearance Required

LMI is a digital solutions provider supporting government missions with innovative technology, AI, and software platforms. LMI is seeking a Data Engineer to lead the development and operation of data pipelines, ontologies, and applications in Palantir Foundry, with additional Databricks responsibilities supporting Army AI2C mission applications. The role also provides technical leadership, mentorship, stakeholder consultation, and integration of AI/ML capabilities.

Responsibilities:

• Lead data engineering efforts within Palantir Foundry (Vantage), including ontology design, pipeline development, and data integration for Army AI2C mission applications
• Build, maintain, and optimize Foundry pipelines using Python-based transforms (PySpark/Pipeline Builder), Code Repositories, and Foundry’s data connection framework
• Develop and maintain data engineering workflows in Databricks, including notebooks, Delta Lake tables, and Spark jobs, for workloads that complement or feed into the Foundry environment
• Write, design, and implement efficient, reusable, and reliable code using Python, PySpark, SQL, and TypeScript/JavaScript as needed for Foundry Workshop or Slate applications
• Translate complex data science and analytics outputs into governed, reusable data products surfaced through Foundry and Databricks
• Lead the integration of AI/ML capabilities into Foundry and Databricks-based applications, identifying opportunities to leverage emerging AI technologies (including Foundry AIP or Databricks ML/AI tooling)
• Champion AI-forward, platform-first development practices and guide the team in implementing AI/ML features and data-driven experiences
• Provide technical leadership and mentorship to grow the team’s capabilities across Foundry (Vantage) and Databricks
• Identify and pursue opportunities to expand development initiatives with Army stakeholders
• Collaborate effectively with data scientists, UX designers, and software developers using Git, participating in code reviews and adopting Agile methodologies
• Engage with Army managers and representatives in a consultative capacity to identify data platform needs, explore innovative data-driven solutions including AI applications, and build strategic relationships that expand our development footprint
• Comfortable working independently and as a member of a team, with demonstrated ability to work in strategic and consultant-oriented environments
• Excellent verbal and written communication skills with ability to articulate technical concepts to non-technical stakeholders and influence strategic decisions

Requirements:

• • Bachelor's degree in Computer Science, Data Science, Data Engineering, Software Engineering, Information Systems, or a related field, or equivalent work experience
• • 3-5 years of experience in data engineering, with hands-on experience building and operating applications on the Palantir Foundry (Vantage) platform
• • Demonstrated experience with Foundry pipeline development (PySpark/Pipeline Builder), Code Repositories, ontology/object modeling, and Foundry Workshop application building
• • Working experience with Databricks, including notebooks, Delta Lake, and Spark-based data processing, as a secondary platform to Foundry
• • Proficiency in Python and SQL for data manipulation and pipeline development (pandas, PySpark, numpy, or similar)
• • Familiarity with data visualization approaches (D3.js, Plotly, Recharts, or Foundry-native Workshop widgets) for surfacing pipeline outputs
• • Demonstrated experience in planning, analyzing, designing, implementing, testing, and maintaining data pipelines and applications for an enterprise-level system
• • Familiarity with Git, Agile methodologies, CI/CD, and automated deployments
• • Demonstrated experience in leadership roles, technical mentorship, or client relationship management
• • Active Secret Clearance or ability to obtain one is required
• Applicants must meet eligibility requirements for a U.S. Government security clearance. Only US Citizens are eligible for a security clearance
• • Experience integrating AI/ML capabilities into Foundry or Databricks-based applications and identifying strategic AI use cases
• • Familiarity with AI frameworks and APIs (OpenAI, Anthropic Claude, LangChain, or similar) and with Foundry AIP
• • Knowledge of statistical analysis and machine learning concepts
• • Experience with Storybook for component development, documentation, and design system management
• • Hands-on deployment experience across multiple environments and platforms, including classified/air-gapped Foundry instances
• • Knowledge of the Army software development process and its technologies or experience developing applications for classified data
• • Background working in strategic planning or consultant environments supporting government or DoD clients
• • Proven track record of expanding technical scope or footprint with government customers
• • 7+ years of directly related experience
• • Master's degree in Computer Science, Data Science, Data Engineering, Software Engineering, Information Systems, or related field
• • On-site (Pittsburgh) candidates preferred