Senior Data Engineer
United States
Full Time
1 hour ago
$100,000 - $185,000 USD
H1B Sponsor Likely
Key skills
Azure Data ServicesETL Pipeline DevelopmentAdvanced SQL ProgrammingData Architecture DesignData IntegrationBig Data TechnologiesPerformance MonitoringData TransformationPythonSQLETLData WarehousingData LakeAnalyticsDatabricksSparkAzureAzure FunctionsAzure SQLBlob StorageCosmos DBPerformance Optimization
About this role
Charles River Laboratories is a contract research organization that focuses on advancing drug therapies to improve global health. They are seeking a Senior Data Engineer to design, implement, and optimize data architecture on Azure, as well as develop and maintain ETL pipelines for data integration and transformation.
Responsibilities:
- Designing, implementing, and optimizing data architecture on Azure, including databases, data lakes, and data warehouses
- Implementing and managing Azure data services such as Azure SQL Database, Azure Data Lake Storage, and others
- Building and maintaining ETL pipelines to move and transform data from various sources to target destinations in Azure
- Integrating data from diverse sources and transforming it into a unified format for analysis
- Monitoring the performance of data systems and optimizing queries, storage, and processing for efficiency
- Collaborating with data scientists, analysts, and other teams to understand their data requirements and provide necessary support
Requirements:
- Bachelor's degree, in Computer Engineering, Computer Science, Electronic Engineering, or related field, or foreign degree equivalent
- Seven (7) years of experience in ETL design, performance optimization, and implementation in a multi-dimensional Data Warehousing environment
- 7 years of advanced SQL Programming: T-SQL
- 5 years of experience in designing and implementing Enterprise Data & Analytics solutions, focusing on architecture and strategy development to drive data-driven business decisions
- 3 years of hands-on experience with data-heavy and analytics applications, utilizing relational databases, data warehousing, and big data technologies such as HDFS, Hive, Sqoop, Spark, and Python for data processing and analysis
- 2 years of experience with Azure cloud technologies, including Azure Data Factory, Azure Data Lake Gen2, Azure Databricks, Blob Storage, Azure SQL Database, Azure Functions, and Cosmos DB, enabling scalable and efficient data pipelines and solutions