Data Engineer / Sr. Data Engineer (Big Query)

Applied Systems is seeking a Data Engineer / Senior Data Engineer to build and enhance data solutions and AI initiatives for the business of insurance. The role involves collaborating with data architects and engineers to optimize data architecture and accessibility while managing large-scale datasets.

Responsibilities:

• Code BigQuery procedures, functions, and other database objects by applying expert knowledge in BigQuery SQL and ANSI SQL
• Implement scalable and efficient data models within our data lake, with a focus on BigQuery
• Manage and optimize data storage, partitioning, and clustering strategies to ensure high performance and reliability of our data infrastructure
• Develop and implement features and enhancements in BigQuery, leveraging your expertise in SQL and cloud-based data warehousing technologies
• Collaborate with cross-functional teams to understand requirements and deliver solutions aligned with business objectives, security requirements, and guidelines for data governance
• Develop documentation for the team to support design discussions
• Ensure data integrity and quality by implementing robust data validation and error-handling mechanisms
• Identify and implement improvements across the full lifecycle of data management, from ingestion to ETL processes and final reporting layers, to increase productivity on the team
• Continuously build knowledge of industry trends and advancements in data engineering and big data technologies
• Support delivery by sharing comprehensive feedback in code reviews and guidance about alignment with standards when solving complex problems
• Assess opportunities and risks of various solutions to provide insights and input needed for technical decisions as we continuously build for scalability and security while maintaining high velocity
• Share advanced knowledge prior experience building data infrastructure and managing unstructured data
• Support with continuous improvement of internal processes and documentation to champion a principles-based approaches to design, implementation, and testing

Requirements:

• 3+ years of experience in modeling, building, and maintaining data solutions in cloud-based environments
• Proficiency in SQL and Python to manipulate, store, manage, or retrieve data assets
• Knowledge of Agile frameworks, ideally Scrum, and tools like Jira and Confluence
• Demonstrated analytical and problem-solving skills and detail orientation
• Bachelor-level degree in Computer Science, MIS, or CIS, or equivalent experience
• Ability to code BigQuery procedures, functions, and other database objects by applying expert knowledge in BigQuery SQL and ANSI SQL
• Implement scalable and efficient data models within our data lake, with a focus on BigQuery
• Manage and optimize data storage, partitioning, and clustering strategies to ensure high performance and reliability of our data infrastructure
• Develop and implement features and enhancements in BigQuery, leveraging expertise in SQL and cloud-based data warehousing technologies
• Collaborate with cross-functional teams to understand requirements and deliver solutions aligned with business objectives, security requirements, and guidelines for data governance
• Develop documentation for the team to support design discussions
• Ensure data integrity and quality by implementing robust data validation and error-handling mechanisms
• Identify and implement improvements across the full lifecycle of data management, from ingestion to ETL processes and final reporting layers, to increase productivity on the team
• Continuously build knowledge of industry trends and advancements in data engineering and big data technologies