Data Engineer - Senior
Raleigh, North Carolina, United States of America
Contract
1 week ago
Key skills
PythonSQLETLData EngineeringBusiness IntelligenceSnowflakeS3AgileCommunicationCollaboration
About this role
CCS Global Tech is a rapidly growing Information Technology company with a diverse portfolio of technology products and services and a large network of industry partnerships. With over 22 years of being a successful business with a global talent pool and presence, CCS is a certified Microsoft Gold Partner and specializes in delivering expert Microsoft based solutions for technical and business needs. We have been recognized by Inc. 500 Magazine as one of the fastest growing small companies in the Unites States.
we are a Tier 1 vendor for the City and County of San Francisco for Cloud Services, Staffing Services and Training Services. For this multi-year opportunity with a diverse set of needs to address, we are currently focusing on establishing partnerships with individuals as well as companies who can help us enhance our overall service portfolio, cut lead times, and ultimately help us deliver successfully. We currently hold sizable Government accounts in the San Francisco bay area including City and County of San Francisco, San Mateo County, and Santa Clara County.
We take great pride in our global reach and local influence. Your experience alongside our highly skilled and talented internal team who guide you along the way, offers key insights into what helps you stand out in a competitive job market.
If you are a partner company, please submit resumes with contact information of your own W2 Consultants only. Submitted consultants are expected to have excellent communication skills.
Roles/Responsibilities:
- Quality Assurance & Quality Checking: Implement and maintain data quality to ensure the accuracy and reliability of data throughout the ETL process.
- ETL Processes: Design, develop, and optimize ETL workflows to efficiently transfer data from file transfer services to S3 buckets and Snowflake.
- Data Integration: Ensure seamless data integration into data platform, enabling efficient consumption by downstream applications and reporting tools.
- Data Quality Management: Address data quality challenges, including inconsistencies in source data that do not meet ingestion requirements, which can lead to load failures or data backouts.
- Collaboration: Work closely with business owners, data analysts, business intelligence teams, and other stakeholders to understand data requirements and deliver high-quality data solutions.
- Monitoring & Troubleshooting: To preserve data flow and integrity, monitor pipelines, identify issues, and implement solutions.
Mandatory Skills:
- 5 years- Demonstrated mid-level+ experience in data engineering, with an emphasis on data quality assurance and ETL processes.
- 5 years- Expertise in Python, PyPI, and SQL
- 5 years- Demonstrate a strong understanding of cybersecurity principles related to code development, DevOps, data access, and fundamental cybersecurity.
- 5 years- Understanding of fundamental public-cloud capabilities.
- 5 years- Proven capacity to comprehend business needs and convert them into technical requirements.
- Demonstrated mid-level+ experience in data engineering, with a emphasis on data quality assurance and ETL processes.
- Expertise in Python, PyPI, and SQL
- Expert analytical and problem-solving skills.
- Demonstrate a strong understanding of cybersecurity principles related to code development, DevOps, data access, and fundamental cybersecurity.
- Understanding of fundamental public-cloud capabilities.
- Proven capacity to comprehend business needs and convert them into technical requirements.
- Demonstrated excellence in communication and collaboration abilities.
- Proven capacity to define success, deliver, and operate in an agile setting.
Desirable Skills: N/A