Software Engineer II

Uplight develops software that manages distributed energy resources to support grid efficiency, reliability, and decarbonization. The Software Engineer II will join the Delivery & Intelligence team to build and maintain multi-cloud data infrastructure, pipelines, CI/CD systems, data models, and monitoring for demand response programs involving large numbers of IoT devices.

Responsibilities:

• Build and maintain multi-cloud Databricks infrastructure using Terraform and Databricks functionality across AWS and GCP
• Build and maintain data pipelines that process hundreds of thousands of IoT devices
• Develop and maintain CI/CD pipelines in CircleCI, including OIDC authentication and service principal deployment patterns
• Contribute to a full service ownership culture by managing the underlying cloud infrastructure using modern Infrastructure as Code (IaC) practices
• Build cost-effective, scalable data models for various relational databases, ensuring the system is performant and reliable
• Implement automated systems and processes to monitor data quality, ensuring production data is consistently accurate and highly available for dependent business processes
• Ensure system reliability through rigorous unit and end-to-end regression testing, proactive system monitoring, performance benchmarking, and debugging of production issues

Requirements:

• 2 to 5 years of software engineering experience using at least one of the major cloud providers, ideally in infrastructure or data platform roles
• Experience with Databricks or a similar data platform
• Proficiency in Python; working knowledge of SQL
• Experience consuming large data sets from APIs
• Some familiarity with data engineering concepts like ETL pipelines, data modeling, or workflow orchestration
• Some experience with Terraform or similar Infrastructure-as-Code tools for managing cloud resources
• Comfortable asking questions, working through unclear requirements, and learning from the engineers around you
• Candidates must be eligible to obtain CFIUS approval as a condition of employment
• Familiarity with Databricks, Databricks Asset Bundles, and Unity Catalog
• Experience with multi-cloud
• AWS
• GCP
• Additional data engineering experience with Spark, Delta Lake, or similar frameworks