Corel CorporationRemote
Senior Data Engineer
United States
Full-time
2 days ago
$190,000 - $200,000 USD
H1B Sponsor Likely
Key skills
PythonSQLMachine LearningETLData EngineeringData LakeBusiness IntelligenceSnowflakeSparkKafkaAirflowAWSGCPKubernetes
About this role
Corel Corporation is looking for an experienced Senior Data Engineer to help transform how the world works. In this role, you will develop and maintain data infrastructure and various data flows, ensuring continuous data validation and telemetry for all data processes.
Responsibilities:
- Design, develop and implement large scale, high-volume, high-performance data infrastructure and pipelines for Data Lake and Data Warehouse
- Build and implement ETL frameworks to improve code quality and reliability
- Build and enforce common design patterns to increase code maintainability
- Ensure accuracy and consistency of data processing, results, and reporting
- Design cloud-native data pipelines, automation routines, and database schemas that can be leveraged to do predictive and prescriptive machine learning
- Communicate ideas clearly, both verbally and through concise documentation, to various business sponsors, business analysts and technical resources
- Guide and mentor other Data Engineers as a technical owner of parts of the data platform
Requirements:
- Expert knowledge of Python
- Expert knowledge of SQL
- Experience with DevOps mode of work
- 7+ years of professional experience
- 5+ years of experience working in data engineering, business intelligence, or a similar role
- 5+ years of experience in ETL orchestration and workflow management tools like Airflow, flink, etc. using AWS/GCP
- 3+ years of experience with the distributed data processing tools like Spark, Presto, etc. and streaming technologies such as Kafka/Flink
- 3+ years of experience with SnowFlake (preferred) or another big data database platform
- 3+ years of experience with cloud service providers: Amazon AWS (preferred), or one of the other major clouds
- Expertise with containerization orchestration engines (Kubernetes)
- MS in Computer Science, Software Engineering, or relevant field preferred, BS in one of same fields acceptable
- 3+ years of experience with SnowFlake
- 3+ years of experience with Amazon AWS
- MS in Computer Science, Software Engineering, or relevant field