Russell Tobin is supporting a major technology client in the search for a highly skilled Data Engineer with a strong emphasis on API development, integration, and database engineering. This role involves designing and maintaining scalable data pipelines, managing APIs, and collaborating with analytics teams to ensure high-quality data availability.
Responsibilities:
- Design, develop, and maintain scalable data pipelines for API data ingestion
- Build and manage APIs, including authentication, error handling, and data parsing
- Optimize and maintain relational databases (primarily Postgres)
- Develop and optimize data models in Snowflake
- Use Databricks (PySpark, notebooks) for data processing and pipeline orchestration
- Collaborate with analytics and BI teams to deliver clean, structured datasets
- Support reporting tools such as Tableau by ensuring high-quality data availability
- Monitor and improve performance of data workflows and systems
Requirements:
- Proven experience as a Data Engineer with strong API development/integration experience
- Demonstrated experience building API-driven data pipelines
- Strong SQL skills, including database design, query optimization, and performance tuning
- Hands-on experience with Postgres or similar relational databases
- Experience with Snowflake (data loading, querying, performance optimization)
- Experience with Databricks (ETL/ELT, PySpark, notebooks)
- Proficiency in Python or similar programming language
- Experience working in cloud environments (AWS, Azure, or GCP)
- Strong understanding of data warehousing concepts and best practices
- Experience supporting BI tools such as Tableau
- Excellent problem-solving skills and ability to work independently
- Strong communication and collaboration skills
- Experience with ETL/orchestration tools (Airflow, Fivetran, dbt)
- Familiarity with containerization (Docker)
- Experience working in consulting or contract roles
- Knowledge of data governance and compliance standards
- Experience supporting Tableau dashboards or BI developers