Key skills
PythonSQLData EngineeringBigQueryRedshiftSparkApache SparkKafkaAirflowAWSAzureGCPTerraformKubernetesDockerAthenaCI/CDLeadershipCommunication
About this role
Pax8 is transforming the cloud marketplace, and data is at the heart of it. They are seeking a Data Engineer II who will design and optimize data pipelines, mentor junior engineers, and improve deployment processes.
Responsibilities:
- Design, build, and optimize robust data pipelines using Python and SQL
- Transform and manage data to support diverse use cases across the business
- Lead by example—mentor junior engineers and champion clean, testable code
- Improve deployment processes and CI/CD pipelines
- Collaborate on architecture and project planning for long-term initiatives
- Troubleshoot data issues and contribute to on-call rotations
Requirements:
- 3+ years of hands-on data engineering experience
- Advanced proficiency in Python and SQL
- Experience with Apache Spark, Kafka, and orchestration tools like Airflow or Prefect
- Familiarity with cloud platforms (AWS, Azure, GCP) and infrastructure tools (Terraform, Docker, Kubernetes)
- Strong understanding of analytical databases (Redshift, Athena, BigQuery)
- Effective problem-solving and technical leadership skills
- Excellent communication and a passion for innovative design
- B.A./B.S. in a related field or equivalent experience required
- M.S./M.A. preferred