Data Engineer

VAS, a URUS Group company, provides farm management software and information solutions that connect agricultural data. The Data Engineer will design, build, and maintain Databricks-based data pipelines and datasets supporting reporting, analytics, and AI/ML workloads while improving performance, reliability, data quality, and scalability.

Responsibilities:

• Design, build, and maintain scalable ETL/ELT pipelines and datasets in Databricks using Python, Spark, and SQL
• Develop and support batch and streaming data architectures for reporting, analytics, and AI/ML workloads
• Troubleshoot and optimize Databricks and existing data integration processes for performance, reliability, and data latency
• Support and enhance existing SQL Server, SSIS, and SSRS solutions while contributing to ongoing platform modernization
• Implement data quality checks, validation, cleansing, and data warehousing best practices across data pipelines and reporting environments
• Integrate Databricks with enterprise applications, databases, and other data sources
• Partner with business users, analysts, and IT teams to translate reporting and data needs into scalable technical solutions
• Contribute to continuous improvement through emerging data engineering practices, AI-assisted development tools, documentation, and ongoing learning

Requirements:

• Bachelor's degree in Computer Science, Information Systems, or a related field
• Strong hands-on experience with Databricks, including Python, Spark, and Delta Lake
• Strong SQL Server and data warehousing experience, including T-SQL
• Experience with SSIS and SSRS
• Experience with Microsoft Azure; Microsoft Fabric is a plus
• Experience using AI-assisted development tools as part of the engineering workflow
• Strong analytical, problem-solving, communication, and collaboration skills