TechData Service Company, LLC is seeking a highly experienced Senior Data Engineer responsible for designing, developing, and optimizing enterprise-scale data infrastructure and pipelines. The role focuses on ensuring data platform scalability and delivering high-quality data solutions while mentoring junior engineers and enforcing data quality standards.
Responsibilities:
- Data Pipeline Development
- Design scalable systems and build complex, end-to-end ETL (Extract, Transform, Load) pipelines to move data from various sources to data warehouses
- Data Governance & Security
- Enforce strict data quality standards and ensure all system designs meet security compliance requirements
- Leadership & Strategy
- Mentor junior engineers, translate complex business requirements into technical solutions
- Performance Optimization
- Continuously monitor and troubleshoot data pipelines and databases to improve processing speed, scalability, and cost-efficiency
- Collaboration & Stakeholder Support
- Ensure implemented Data Products meet the vision and goals of Data Consumers
- Documentation & Best Practices
- Enforce and adhere to best practices for technical documentation related to architecture, transformation logic and coding standards
Requirements:
- 10+ years of prior experience as a Data Engineer working directly with Data Warehouses, Data Lakes, ELT/ETL, Data Pipelines
- Bachelor's degree in Computer Science, Information Systems, Engineering, or a related technical field
- Languages: Advanced proficiency in SQL and Python
- Cloud Platforms: Amazon Web Services (AWS), Google Cloud Platform (GCP), or Microsoft Azure
- Data Warehouses & Frameworks: BigQuery or Redshift
- Orchestration & Streaming: Apache Airflow, dbt (data build tool)
- US-based, Eastern/Central Time Zone
- Fluent English Speaker
- AWS: 1 year (Required)
- Google Cloud Platform: 1 year (Required)
- Data warehouse: 3 years (Required)
- Data lake: 3 years (Required)
- ELT/ETL: 3 years (Required)
- Data pipelines: 2 years (Required)
- SQL: 2 years (Required)
- Python: 2 years (Required)
- 15+ years of prior experience as a Data Engineer working directly with Data Warehouses, Data Lakes, ELT/ETL, Data Pipelines
- Master's degree in Computer Science, Information Systems, Engineering, or a related technical field
- Experience optimizing Data Pipelines
- Prior experience working in the Pharma industry
- Experience with BI Tools (e.g. Tableau)
- MS Azure: 1 year (Preferred)
- Pharma Industry: 1 year (Preferred)
- BigQuery: 1 year (Preferred)
- Redshift: 1 year (Preferred)
- Data Engineer: 10 years (Preferred)