Principal Data Engineer

ADTRAV Travel Management is a leading business travel management company with over four decades of experience. They are seeking a Principal Data Engineer to lead the design, development, and implementation of components within their business intelligence application, focusing on data ingestion, storage, and processing solutions.

Responsibilities:

• Lead the design, development, and implementation of major components of the RezIntel platform
• Work with cross-functional teams to gather requirements and understand data needs
• Implement data ingestion, storage, and processing solutions for structured and unstructured data
• Ensure the data storage system is scalable and highly available
• Develop and maintain data pipelines and ETL/ELT processes
• Maintain a strong understanding of a data lifecycle
• Conduct data modeling and create documentation like data definitions, data flow diagrams, and process definitions
• Automate and ensure data quality
• Design and develop database objects, tables, stored procedures, views, and ETL pipelines
• Conduct performance tuning of T-SQL, including stored procedures, views, functions, etc
• Mentor and instruct other engineers on best practices
• Analyze, solve, and correct issues in real-time
• Provide engineering estimates
• Use Agile development tools to track and communicate project progress
• Stay up to date on new information technologies and emerging trends, and their possible application in the company
• Work non-standard business hours to attend meetings and provide support via text/phone/email in a 24/7/365 environment
• Represent ADTRAV by embracing the company values and maintaining effective working relationships with employees, partners, vendors, and clients
• Adhere to company policies and procedures
• Other duties as assigned

Requirements:

• Bachelor's Degree in related field or equivalent experience required
• 10+ years of experience in ETL technologies and concepts like SSIS and Python/Pandas
• 8+ years of experience in Data Warehousing, DataVault, and Data Mart concepts and implementation especially in relational databases like SQL Server
• Ability to mentor engineering teams on best practices
• Strong SQL knowledge and work experience with relational databases such as Microsoft SQL Server, or PostgreSQL
• Experience in architecting, crafting, and developing highly scalable distributed data processing systems
• Experience architecting DataVault and/or Kimbell systems
• Experience in using visualization and reporting tools such as SSRS, Qlik Sense, and PowerBI
• Experience implementing data solutions in Azure and on-prem data centers using ETL tools, queues, batch scheduling services and various storage solutions
• Background in data analysis and data modeling
• Experience in Agile SDLC methodologies (Kanban and Scrum)
• Experience building and deploying applications using continuous integration pipelines and automated deployment tools such as Azure DevOps, etc
• Hands on experience with Python, Pandas, and other Python ETL tools required
• Ability to estimate the work required and deliver the project on schedule as estimated
• Experience with source control such as Git or TFS
• Experience with issue tracking systems such as Jira or Azure DevOps
• Ability to learn ADTRAV's business and products quickly and adapt to a dynamic development environment
• Excellent English written and verbal communication skills
• Ability to communicate ideas and concepts clearly and concisely, while also being open to receive feedback and direction as needed
• Highly self-motivated and able to prioritize and manage multiple tasks with varying deadlines
• Able to work in a fast-paced environment while balancing both strategic and tactical responsibilities
• Detail oriented with strong organizational and analytical skills
• “Can do” problem solving mentality, while still respecting standards, quality, and security
• Able to present a professional and positive demeanor with internal and external customers/clients and work cooperatively
• Ability to work remotely and meet the company home-office requirements, including stable, high-speed internet
• Able to maintain confidentiality of company and client information
• Able to work outside of normal business hours and provide 24/7/365 support to team
• Able to successfully pass a credit, criminal, and/or employment reference background check
• This position has access to data as part of a government contract, and it is a requirement of the contract for individuals to be a U.S. citizen. Candidates must be able to show proof upon hire that they meet this requirement
• Able to successfully pass a government clearance process as required by clients