Senior Data Engineer

LanceSoft, Inc. is recruiting for a confidential company seeking a Senior Data Engineer for its Business Data team within Agent Software and Advertising. The role leads analytics initiatives, designs and maintains scalable data pipelines, translates business requirements into data models, improves engineering efficiency and reliability, and mentors team members.

Responsibilities:

• Collaborate with team members across product, engineering, support, operations, marketing, sales and more to understand business needs and convert them to technical requirements
• Design and implement scalable data pipelines to collect, process, and store large volumes of critical data from various sources
• Provide data reliability and uptime by monitoring and troubleshooting data pipeline performance and scalability to ensure efficient operations
• You are a "lazy" engineer - continuously seeking to improve the team's efficiency by automating repeatable processes
• You are a fast learner with strong business insight and can collaborate with various product partners to quickly acquire a deep understanding of the business processes that feed into our team's data pipelines
• Authoritatively translate business use cases into well-thought-out data models that are easy to evolve with the business
• Communicate technical concepts effectively to non-technical audiences
• You are a bar-raiser for engineering best practices - carefully reviewing specifications, designs, pull requests and providing constructive/helpful feedback to raise the quality of our team's output
• Consistently write high-quality code, refactor, and optimize for better scalability, performance, and readability
• Provide leadership within the team and mentor other team members

Requirements:

• • A degree (BS+) in Computer Science or a related field
• • 5+ years of experience building and maintaining data-intensive applications
• • Experience developing sophisticated data pipelines scaling to billions of rows with production quality deployment, monitoring and reliability
• • Extensive experience with modern data technologies such as Spark and Airflow
• • Strong proficiency in programming languages such as Python, Java, or Scala
• • Extensive experience with SQL
• • Proven data modeling experience, translating business requirements into clean and easily evolvable data models
• • Excellent interpersonal skills and a passion for collaborating across organizational boundaries
• • Experience working with cloud services (AWS/Azure/GCP)
• • Experience with Databricks
• • Understanding of data visualization tools (e.g., Tableau, Power BI)
• • We value the experience and perspective of candidates with non-traditional backgrounds. We encourage you to apply if you have transferable skills or related experiences