Data & LLM Systems Engineer

L'ATTITUDE VENTURES is focused on building the automation engine for next-generation circuit design. The role involves developing internal tooling, analytics platforms, and customer-facing applications to support the Generative AI team, while collaborating with product and engineering teams to solve real problems.

Responsibilities:

• Collaborate closely with product and engineering teams to understand workflows and build tools that solve real problems
• Own the evaluation and observability layer for our AI products — building dashboards, analytics pipelines, and reporting tools that give the Gen AI team and stakeholders visibility into model performance, usage, and customer outcomes
• Develop customer-facing tooling and lightweight web applications that surface AI-powered insights and enable seamless interaction with AllSpice's products
• Build and maintain scripts, data pipelines, and integrations that connect internal systems, third-party services, LLMs, and MCPs
• Write clear documentation and communicate findings to both technical and non-technical audiences, including leadership and customers
• Champion code quality, testing, and reliability across the tooling stack through reviews, mentorship, and thoughtful design
• Build interactive internal dashboards to track DRCY performance metrics, customer usage patterns, and model quality over time
• Develop a lightweight web application that allows customers to explore AI-generated design review results, drill into findings, and provide feedback
• Create and maintain data pipelines that aggregate evaluation results, customer feedback, and telemetry into a unified analytics layer
• Build scripting tools and automations to streamline the Gen AI team's development and testing workflows (e.g., batch evaluation runs, report generation)
• Design and implement RAG-based information repositories and tooling to capture component data and domain knowledge for use by our suite of AI products
• Integrate with CI/CD systems (GitHub Actions) to surface AI insights directly in engineering workflows
• Work with infrastructure to maintain appropriate reporting for centralized cache service