Pyspark/Data Engineer
United States of America
Full-time
2 hours ago
$54 - $55 USD
Visa Sponsor
Key skills
ETLMicrosoft SQL ServerRelational DatabaseSQL Performance TuningHadoopSparkImpalaHivePythonCloudera Hadoop EcosystemKafkaHueOozieYarnSqoopHealthcare Claims DataData Movement and TransformationSQLAnalyticsIntegration TestingSQL Serveryarn
About this role
Randstad Digital Americas is a leading Healthcare Analytics company seeking a Software/Data Engineer. The role involves designing and developing software modules, creating and maintaining ETL scripts, and ensuring adherence to software engineering best practices.
Responsibilities:
- Design and develop high quality, maintainable software modules for the Cotiviti, Inc. product suite
- Conduct unit and integration testing using appropriate methodology and techniques
- Analyze requirements and specifications and create detailed designs for implementation
- Analyze and resolve software related issues originated from internal or external customers
- Continuously update professional knowledge of new technologies as selected and integrated into the Cotiviti, Inc. product suite
- Review software engineering approach to proposed solutions to ensure adherence to best practice
- Complete all special projects and other duties as assigned
- Must be able to perform duties with or without reasonable accommodation
- Work as a team member in the creation and maintenance of ETL scripts, tools, queries, and applications used for healthcare data management, data validation, statistical report generation, and program validation
Requirements:
- Strong working knowledge of ETL, database technologies, big data and data processing skills
- 5+ years in Microsoft SQL Server and Relation Database developing data extraction applications
- Experience in resolving performance issues with high data volume procedures in SQL and how different types of index works
- 2+ years of experience developing applications using Hadoop, Spark, Impala, Hive, Python
- 2+ years of experience in running, using and troubleshooting the ETL Cloudera Hadoop Ecosystem i.e. Hadoop FS, Hive, Impala, Spark, Kafka, Hue, Oozie, Yarn and Sqoop
- Experience processing large amounts of structured and unstructured data with Spark
- Experience with data movement and transformation technologies
- Have a good understanding of the E2E process of the application
- Health care claim data knowledge is highly preferred
- Healthcare Experience a Plus