Data Engineering Team Lead

Role Overview

• Lead a team of data engineers, ensuring alignment on goals, quality and delivery timelines.
• Mentor and coach team members to support their technical and professional growth.
• Drive engineering excellence by promoting best practices in coding, architecture, testing and observability.
• Plan and manage team capacity, sprints and milestones to ensure predictable delivery.
• Own the design, evolution and operation of ingestion and transformation pipelines on Apache Airflow and the analytical serving layer on Apache Druid.
• Make architectural calls on concurrency, partitioning, memory sizing and cost — including JVM heap and direct-memory tuning on the Druid cluster.
• Collaborate closely with DevOps on the Kubernetes / EKS platform that hosts our Druid and Airflow workloads.
• Ensure robust data validation, reconciliation and verification so that reporting is trustworthy.
• Collaborate with other Team Leaders, Development Managers, Architects and Product Owners to align engineering execution with business objectives.
• Contribute to the evolution of development processes, CI/CD pipelines and DevOps practices.
• Foster a culture of continuous improvement, innovation and knowledge sharing.

Requirements

• 10+ years of commercial experience delivering Data & Analytics solutions.
• 5+ years leading a Data Engineering or BI team with a solid grasp of Agile methodologies (Scrum / Kanban).
• Strong hands-on expertise in Apache Airflow — production DAG authoring in Python; hooks, sensors, XCom, callbacks, retries; dynamic task mapping.
• Production-grade Python — type hints, packaging, pytest; comfortable reading and reviewing other people's DAGs.
• Apache Druid (ingestion-side) — index_parallel specs, transformSpec / dimensionsSpec / granularitySpec, tuningConfig, supervisors, task lifecycle, segment management; familiarity with Coordinator / Overlord / Broker / Historical / MiddleManager roles.
• Strong PostgreSQL — query tuning, JSONB, window functions, indexes, EXPLAIN / EXPLAIN ANALYZE.
• SQL fluency across dialects (Postgres, T-SQL, Oracle); comfortable optimising queries.
• AWS data services — S3 (Druid deep storage), EMR, Secrets Manager, IAM, VPC fundamentals; EC2 sizing for memory-bound workloads.
• Production debugging instincts — reading YARN container logs, tracing failure from Airflow → EMR step → Spark driver → Python traceback.
• Exceptional communication, teamwork, attention to detail, organisational and leadership skills.
• Ability to inspire, mentor and lead by example.****

Nice to have

• JVM tuning — heap (Xms / Xmx), direct memory, GC choice (G1, ZGC), reading GC logs; distinguishing JVM OOM from cgroup OOMKilled.
• Kubernetes operations — pods, Deployments / StatefulSets, ConfigMaps, resource requests vs limits, HPA, kubectl describe / exec / logs.
• Helm / Helmfile — most production Druid on EKS is Helm-deployed.
• PySpark — DataFrame API, Spark SQL, JDBC reads / writes; deploy-mode cluster vs client; executor / driver memory.
• Delta Lake — MERGE semantics, time-travel, schema evolution, SCD Type 1 / 2.
• CI/CD on Bitbucket Pipelines (or transferable: GitHub Actions / GitLab CI) — OIDC-to-AWS, deploy gates, artifact handling.
• Observability — Prometheus / Grafana for Druid metrics, distributed tracing, log aggregation (CloudWatch / Loki / ELK).
• Terraform / IaC.
• Other Druid ingestion sources — Kafka, Kinesis, S3 / Parquet, batch SQL.
• dbt, Spark or Beam — for source-side transformation outside Druid.
• Druid row-level-security patterns (RLSGroupID / parse_json transformSpec) — multi-tenant Druid experience would stand out.
• Maritime / personnel data domain (IMO, Installation, CustomerID, Personnel Pool).

Tech Stack

• Airflow
• Apache
• AWS
• EC2
• Grafana
• Kafka
• Kubernetes
• Oracle
• Postgres
• Prometheus
• PySpark
• Python
• Spark
• SQL
• Terraform
• Yarn

Benefits

**Safeguard your tomorrow: **

• Future Security with SSS & HDMF: Secure your financial future and home ownership dreams with contributions to Social Security and Home Development Mutual Fund.
• Healthcare Assurance with Philhealth: Rest easy knowing your health is safeguarded by the Philippine Health Insurance Corporation.

** Extra Allowances for Daily Comfort:**

• Boost Your Budget: Receive a monthly allowance of 2,500 PHP for your everyday expenses.

** Top-Tier Health and Wellness Coverage:**

• Comprehensive Medical Insurance: After your initial 3 months, enjoy Maxicare's extensive medical insurance for you and one dependent, including up to 200,000 PHP per illness annually.
• Around-the-Clock Teleconsult: Have 24/7 access to medical consultations, ensuring you and your family's health concerns are promptly addressed.
• Annual Health Maintenance: Benefit from regular check-ups and dental care to maintain your health year-round.
• Life Insurance Peace of Mind: Gain additional security with a life insurance policy valued at 250,000 PHP, protecting what's most important to you.

Employee Support and Wellbeing:

• Employee Assistance Programme (EAP): Our EAP, provided by Health Assured and Comp Psych, offers confidential counseling, financial, and legal support via phone, ensuring your well-being is always a priority.

⭐ OTG’s Guiding Stars:

• ⭐Pioneering: Constantly charting new courses in innovation.
• ⭐Caring: Keeping the maritime community's safety and sustainability at the helm.
• ⭐Collaborating: Navigating together with clear communication and shared goals.
• ⭐Optimizing: Always in pursuit of excellence and constructive evolution.

**🚢 Will You Navigate the Next Chapter with Us****Join us on a journey that transcends a traditional job—it’s a mission to innovate at the intersection of technology and education. Discover more about our vision at OneOcean and see if your path aligns with our pioneering direction. We’re eager to welcome aboard our next visionary Junior Application Consultant, ready to make a significant impact on both tech and educational fronts.****Cast your resume into our waters and embark on a journey that transcends a mere job

• it’s an adventure in innovation and support. Visit us at OneOcean and see if your compass aligns with ours. We’re excited to welcome our next Oceaneer onboard. **** ✊🏼 All Hands on Deck: We steer with equality and celebrate the diversity of our Oceaneer’s. OneOcean is a proud equal opportunity employer, where passion unites and differences are celebrated.