Key skills
RDBMST-SQLNoSQLData LakesSparkPythonScalaMapReduce programming modelDatabase schema designDatabase optimizationDatabase scalabilityAzure cloudAWS cloudService-oriented architectureTesting pyramidUnit testingIntegration testingBlack box testingService testingAgileScrumSQLAIMachine LearningMLBIDatabricksData MiningAWSAzureCommunicationTime Management
About this role
Ex Parte, Inc. is a company that provides data and insight for legal decision-making. They are looking for a Lead Data Engineer to lead a team in building an AI self-service portal and contribute to their data platform, focusing on solving complex client problems and optimizing data processes.
Responsibilities:
- Work directly with product owners and data experts to build products that solve to solve complex client problems
- Build and support a distributed platform supporting all ExParte data
- Work across our product, primarily on the data pipelines
- Interface directly with internal teams
- Evaluate software and implementation options and document them for technical teams
- Work with data analysts to collect insight on possible data collection efficiencies and identify automation potential for manual workflows
- Integrate best qualitative practices in program design and development
- Be a part of a distributed team (we’re in North America and Europe)
- Work with Azure cloud and Databricks
- Develop technical architectures and specific implementations to meet business needs
- Guide the team’s software engineering best practices by documenting standards and completing code reviews
- Troubleshoot new and existing code and provide feedback and solutions to structural issues in the codebase as they arise
- Advise on the feasibility of nonfunctional requirements and ensure the successful implementation of features while meeting those requirements
Requirements:
- 3+ years experience with RDBMS and T-SQL
- 3+ years experience with NoSQL and DataLakes
- 3+ Knowledge of Spark, Python, or Scala
- Strong familiarity with map/reduce programming models
- Proficiency in writing production-quality code
- Deep expertise in database schema design, optimization, and scalability
- Experience with Azure or AWS cloud-based service-oriented architecture
- Solid understanding of testing pyramid (unit, integration, black box, service)
- Experience working in an Agile/Scrum environment
- Strong analytical and problem-solving skills
- Good time management and organizational skills
- Ability to work on challenging issues independently or in a team environment
- Ability to learn and adapt quickly to new technologies and environments
- Strong communication skills
- Experience with Databricks or Azure ML
- Experience applying machine learning algorithms to solve complex data mining problems
- Experience with BI tools
- Understanding of cloud platforms and providers and DevOps
- Bachelor's Degree in Computer Science, Engineering, Mathematics or related field