Da Vinci SoftwareRemote
GCP/Linux Data Engineer (Remote)
Rochester, Minnesota, United States of America
Full Time
18 hours ago
Key skills
JavaC#C++CGolangData EngineeringGCPSource ControlAgileCommunicationProblem SolvingTime Management
About this role
Overview:
Our client is seeking resources that will be supporting an engineering team tasked with building a research data platform which will ingest and make discoverable research generated data.
Key Responsibilities:
Additional Information:
Our client is seeking resources that will be supporting an engineering team tasked with building a research data platform which will ingest and make discoverable research generated data.
Key Responsibilities:
- Data Engineering Skills & Experience:
- Create, verify, and maintain data replication scripts
- Create, verify, and maintain data validation, processing, and ingestion pipelines
- Deploy and automate the execution of data replication scripts and data pipelines in cloud infrastructure
- Create and maintain data catalogs that describe datasets and their contents (i.e. files, file types, tables/views, columns, fields, etc.)
- Create, verify, and maintain dashboards and reports that characterize ingested datasets
- Create, verify, and maintain data validation scripts/APIs that verify the production dataset contains the correct number of samples/records, expects values/fields/columns are populated, and values are of the correct data type, format, and range.
- Deploy and automate the execution of data validation scripts/APIs
- Create and maintain user documentation (dataset descriptions, tutorials, code examples, etc.)
- Define entitlements, user groups, roles, and permissions utilized to grant access to datasets Programming Languages:
- Strong GCP
- Linux system administration and scripting
- Pro Desk API
- Required qualifications for this position include: Bachelor's Degree in Computer Science/Engineering or related field with 5 years of experience as noted below; OR an Associate's degree in Computer/Science/Engineering or related field with 7 years of experience.
- Have in-depth knowledge of software engineering with experience coding applications or services in a high-level language (C, C++, Golang, Java, C# etc.) and a basic knowledge of related fields.
- Demonstrated problem solving and time management skills.
- Possesses strong technical aptitude for designing and implementing software solutions. Experience with modern application development frameworks
- Knowledge of professional software engineering practices & best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
- Deep hands-on technical expertise, excellent verbal and written communication skills.
- Experience with Agile software development techniques.
- Fully Remote
- W2 Candidates Only