ECLARO is seeking a motivated Senior Data Engineer to ensure the processing of third-party data into a usable and scalable format. The role involves constructing data pipelines, performing ad-hoc analysis, developing parsers, and documenting data architecture to enhance the company's data capabilities.
Responsibilities:
- Construct data pipelines using Python to meet business requirements
- Perform ad-hoc analysis to troubleshoot stakeholder issues surrounding data and provide insights into feature usage
- Develop parsers and workflows to integrate with data partners to expand our data capabilities
- Document data architecture and integration efforts to provide a clear understanding of the data platform to other team members
- Tune long running jobs to improve system throughput and create API's for delivering the data to end users
- Design data schemas and structures to create data abstraction layers between systems
- Help maintain, develop, and set up testing frameworks to aid in the robustification of existing systems
- Aid in the creation of development environments to better aid in bringing younger developers onboard
Requirements:
- Software development experience in ELT/ETL, NLP or API development
- Recent professional development experience with the following languages and technologies:
- Python for natural language processing and API development
- Non-relational databases (Redis or NoSQL)
- XML, JSON, CSV data formats
- Agile / scrum processes using Jira and Git
- Networking concepts such as VLAN, NAT, VPN and network device configuration
- Familiarity with the configuration of firewalls, routers, and switches from major networking manufacturers (e.g. Cisco, Palo Alto, Fortinet, etc.)