Data Engineer

Role Overview

• Design, implement, and operate MCP and OCR integrations, ensuring the overall stability and performance of the platform.
• Focus on developing enrichment integrations for LLM prompt generation.
• Optimize platform reliability (performance tuning, DB connection handling, LLM gateway operations, observability, autoscaling).

Requirements

• Design and implement secure, robust integrations with multiple MCP servers to fetch and aggregate customer data (API clients, batching, connection pooling, retries, rate limiting, caching) and feed enriched context into LLM prompt generation.
• Implement and operate OCR integrations for processing attachments (PDFs, images), including tool/API selection, preprocessing, quality handling, and text integration into mail classification and prompt pipelines.
• Ensure secure handling of customer and PII data used in LLM workflows.
• Scale and performance‑tune GenAI Python microservices running in Kubernetes.
• Improve PostgreSQL session and connection management, including detection and resolution of connection leaks.
• Operate and harden the LLM‑Gateway (LiteLLM), implementing load balancing, throttling, and fallback strategies required by GenAI mail‑processing workflows.
• Implement and maintain observability for enrichment and platform workflows (metrics, traces, structured logs) and contribute to runbooks.
• Optional participation in on‑call rotation.
• Hands‑on experience with Kubernetes, Helm, and Docker.
• Strong experience integrating backend APIs, including authentication (tokens/OAuth/OIDC), retries, rate limiting, and caching.
• Practical experience with OCR tools/APIs or document‑processing pipelines.
• Solid Python skills for integration and troubleshooting (FastAPI, Django, Pydantic).
• Familiarity with PostgreSQL connection handling and basic tuning.
• Exposure to observability tools (Prometheus, Grafana, ELK).
• Strong understanding of data privacy and PII handling in production environments.

Tech Stack

• Django
• Docker
• Grafana
• Kubernetes
• Microservices
• Postgres
• Prometheus
• Python

Benefits

• Attractive financial benefits: A cafeteria system that allows employees to personalize benefits by choosing from a variety of options.
• Generous referral bonuses, offering up to PLN6,000 for referring specialists.
• Additional revenue sharing opportunities for initiating partnerships with new clients.
• Professional development and team support: Ongoing guidance from a dedicated Team Manager for each employee.
• Tailored technical mentoring from an assigned technical leader, depending on individual expertise and project needs.
• Community and Well-Being: Dedicated team-building budget for online and on-site team events.
• Opportunities to participate in charitable initiatives and local sports programs.
• A supportive and inclusive work culture with an emphasis on diversity and mutual respect.