Senior Data Engineer

Blu Omega is looking for a Senior Data Engineer to design a cloud-based data solution to support the healthcare data repository for one of their clients. The role involves leading the planning, designing, and deployment of hybrid on-premises and cloud architecture solutions to enable data science and advanced analytics applications.

Responsibilities:

• Recommend standards, tools, and capabilities based on your research of the environment and knowledge
• Explore how to help customers overcome their most difficult challenges in cloud data storage
• Work with the client’s technical leads to implement strategy and architecture design
• Lead the planning, designing, and deployment of hybrid on-premises and cloud architecture solutions for use in a next-gen platform enabling data science and advanced analytics applications leveraging artificial intelligence and machine learning, automation, cloud-based security, and big data
• Focus on growing as a team to make the best solutions for our customers, so you’ll have resources for mentoring and learning new skills and tools
• Join our team as we transform the healthcare capabilities with cloud technology

Requirements:

• 10+ years of experience with IT
• Experience in programming languages such as Python, Scala, or Java
• Experience with data validation, cleansing, and enrichment techniques to improve the accuracy and completeness of data
• Experience with building and optimizing data pipelines to extract data from various sources, transform it into the required format, and load using Databricks and AWS services
• Experience with monitoring and troubleshooting ETL processes to identify and resolve issues in a timely manner
• Experience in designing and developing ETL workflows using tools such as Apache Spark or AWS Glue
• Experience with different data storage technologies and databases, such as Amazon S3 or Amazon Redshift
• Knowledge of ETL best practices, data integration techniques, and data quality management
• Experience with multiple operating systems and languages and planning and implementing large-sized databases
• Knowledge of Cloud database technology, cloud-native data architecture
• Experience with CMS (Centers for Medicare & Medicaid Services) programs
• Ability to obtain and maintain a Public Trust
• Bachelor's degree
• Experience with UNIX/Linux, including basic commands and Shell scripting
• Experience with a public cloud, including AWS, Microsoft Azure, or Google Cloud
• Experience with distributed data and computing tools including Spark, Databricks, Hadoop, Hive, AWS EMR, or Kafka
• Experience working on real-time data and streaming applications
• Experience with NoSQL implementation, including MongoDB or Cassandra
• Experience with data warehousing using AWS Redshift, MySQL, or Snowflake
• Experience with Agile engineering practices
• Knowledge of concepts of Data Lakehouse architecture