Senior Data Engineer, ACVMax
Buffalo, New York, United States of America
Full Time
6 days ago
$130,000 - $180,000 USD
No H1B
Key skills
PythonSQLBashMachine LearningETLELTData EngineeringAnalyticsBIBusiness IntelligenceRedshiftKafkaAirflowAWSAzureGCPEKSEC2LambdaS3SNSSQSGlueAthenaKinesisPostgresMongoDBSQL ServerSaaSMentoringCommunication
About this role
If you are looking for a career at a dynamic company with a people-first mindset and a deep culture of growth and autonomy, ACV is the right place for you! Competitive compensation packages and learning and development opportunities, ACV has what you need to advance to the next level in your career. We will continue to raise the bar every day by investing in our people and technology to help our customers succeed. We hire people who share our passion, bring innovative ideas to the table, and enjoy a collaborative atmosphere.
Who we are:
ACV is a technology company that has revolutionized how dealers buy and sell cars online. We are transforming the automotive industry. ACV Auctions Inc. (ACV), has applied innovation and user-designed, data driven applications and solutions. We are building the most trusted and efficient digital marketplace with data solutions for sourcing, selling and managing used vehicles with transparency and comprehensive insights that were once unimaginable. We are disruptors of the industry and we want you to join us on our journey. Our network of brands include ACV Auctions, ACV Transportation, ClearCar, MAX Digital and ACV Capital within its Marketplace Products, as well as, True360 and Data Services.
At ACV we focus on the Health, Physical, Financial, Social and Emotional Wellness of our Teammates and, to support this, we offer:
• Multiple medical plans including a high deductible, low cost health plan
• Company-sponsored (paid) Short-Term Disability, Long-Term Disability, and Life Insurance
• Comprehensive optional benefits such as Dental, Vision, Supplemental Life/AD&D, Legal/ID Protection, and Accident and Critical Illness Insurance
• Generous paid time off options, including uncapped vacation days, the greater of 3 paid sick days or in accordance with the applicable state or local paid sick leave law, 6 paid company holidays, 2 floating holidays, parental leave, bereavement leave, jury duty leave, voting leave, and other forms of paid leave as required by applicable law or regulation
• Employee Stock Purchase Program with additional opportunities to earn stock in the Company
• Retirement planning through the Company’s 401(k)
Who we are looking for:
In this senior technical role for ACV Retail, you will architect and deliver robust data pipelines, warehouses, and lakes that enable advanced analytics, machine learning, and business intelligence at scale. You will set technical direction, mentor engineering teams, and ensure best practices for performance, security, and cost-effectiveness in our cloud-based data ecosystem. You will collaborate with cross-functional teams to deliver high-quality, robust, and scalable solutions that empower our customers to manage and analyze their data effectively. You will have deep expertise in designing, building, and optimizing modern, scalable data platforms on AWS, MS SQL Server and MongoDB. You will set technical direction, mentor engineering teams, and ensure best practices for performance, security, and cost-effectiveness in our cloud-based data ecosystem.
Our goal is evaluate, plan, and execute the evolution of our legacy data architecture to a more modern approach, allowing deprecation of legacy applications and empowering our new SaaS solutions.
What you will do:
• Design and implement end-to-end data architectures on AWS, including data lakes, data warehouses, real-time streaming pipelines, and ETL/ELT processes.
• Very strong data engineering experience working with AWS Tech Stack with a focus on building complex self healing data engineering pipelines, cloud delta lakes and migrating legacy technology stack to the Cloud
• Extensive experience with reverse engineering legacy stored procedures into data pipelines built using AWS Glue would be an added advantage
• Lead the design of data models, storage solutions, and access patterns that support analytical and operational workloads. Deep understanding of data modeling in Postgres db environments. Ability to reverse engineer legacy data models and redesign with foundational architectural principles including normalization, cardinality and ACID into Postgres databases like Aurora is critical.
• This role requires deep technical expertise, strong communication skills, and the ability to lead complex initiatives across multiple teams. Experience working on multiple projects simultaneously while troubleshooting technical issues and working with cross-functional stakeholders while communicating effectively to influence external engineering teams, product development teams, Business stakeholders and external partners.
• Act as a trusted advisor to stakeholders, bridging business needs with technical execution, and ensuring best practices in cloud architecture, security, and cost optimization. Work closely with our application architects, data scientists and data engineering teams to develop, enhance and define new data integrations and BI solutions.
• Mentor and guide engineering teams in implementing AWS services effectively and efficiently. Stay current with AWS service offerings and emerging cloud technologies, and recommend adoption where appropriate.
• Experience migrating SSIS, SQL Server and other legacy platform to AWS Cloud
• Optimize AWS workloads for performance, scalability and cost efficiency, leveraging tools like Trusted Advisor, Well-Architected Framework, and Cost Explorer.
• Deep experience with services such as:
• Storage & Compute: S3, EMR, Glue, Redshift, Athena, Lambda, EC2, EKS
• Streaming & Messaging: Kinesis, Kafka, MSK, SNS/SQS
• Orchestration & Workflow: Step Functions, Airflow, Data Pipeline
• Databases: Aurora Postgres, MongoDB, MS SQL Server
• Mentor and coach junior engineers, fostering a culture of technical excellence and continuous improvement to mature Data Engineering practices enterprise wide. Deliver TechTalks and training sessions on a regular basis.
• Previous experience in the Auto Industry would be a significant added advantage
What you will need:
• At least 10 or more years of experience working in the data engineering field as a Senior Data Engineer with at least 4 years designing and implementing solutions on AWS
• Solid understanding of SaaS, distributed systems, scalability, and high availability concepts.
• Previous experience mentoring junior data engineers, providing technical expertise, code reviews, and sharing best practices to foster professional growth.
• Excellent problem-solving skills and the ability to navigate complex technical challenges.
• Strong communication skills and the ability to collaborate effectively in cross-functional teams.
• Experience with hybrid cloud and multi-cloud strategies
• Familiarity with other cloud platforms (Azure, GCP)
• Hands-on coding/scripting in Python, Bash, or similar
Key Competencies:
• Strategic mindset with a strong business acumen
• Ability to balance short-term needs with long-term vision
• Problem-solving and analytical skills
• Continuous learner who stays ahead of cloud trends
Our Values
Trust & Transparency | People First | Positive Experiences | Calm Persistence | Never Settling
At ACV, we are committed to an inclusive culture in which every individual is welcomed and empowered to celebrate their true selves. We achieve this by fostering a work environment of acceptance and understanding that is free from discrimination. ACV is committed to being an equal opportunity employer regardless of sex, race, creed, color, religion, marital status, national origin, age, pregnancy, sexual orientation, gender, gender identity, gender expression, genetic information, disability, military status, status as a veteran, or any other protected characteristic. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you have a disability or special need that requires reasonable accommodation, please let us know.
For information on our collection and use of your personal information, please see our Privacy Notice.
No immigration or work visa sponsorship provided for this position.
Compensation: The compensation range for this position is listed in the "Job Details" section at the bottom of this posting. Please note that final compensation will be determined based upon the applicant's relevant experience, skillset, location, business needs, market demands, and other factors as permitted by law.
Who we are:
ACV is a technology company that has revolutionized how dealers buy and sell cars online. We are transforming the automotive industry. ACV Auctions Inc. (ACV), has applied innovation and user-designed, data driven applications and solutions. We are building the most trusted and efficient digital marketplace with data solutions for sourcing, selling and managing used vehicles with transparency and comprehensive insights that were once unimaginable. We are disruptors of the industry and we want you to join us on our journey. Our network of brands include ACV Auctions, ACV Transportation, ClearCar, MAX Digital and ACV Capital within its Marketplace Products, as well as, True360 and Data Services.
At ACV we focus on the Health, Physical, Financial, Social and Emotional Wellness of our Teammates and, to support this, we offer:
• Multiple medical plans including a high deductible, low cost health plan
• Company-sponsored (paid) Short-Term Disability, Long-Term Disability, and Life Insurance
• Comprehensive optional benefits such as Dental, Vision, Supplemental Life/AD&D, Legal/ID Protection, and Accident and Critical Illness Insurance
• Generous paid time off options, including uncapped vacation days, the greater of 3 paid sick days or in accordance with the applicable state or local paid sick leave law, 6 paid company holidays, 2 floating holidays, parental leave, bereavement leave, jury duty leave, voting leave, and other forms of paid leave as required by applicable law or regulation
• Employee Stock Purchase Program with additional opportunities to earn stock in the Company
• Retirement planning through the Company’s 401(k)
Who we are looking for:
In this senior technical role for ACV Retail, you will architect and deliver robust data pipelines, warehouses, and lakes that enable advanced analytics, machine learning, and business intelligence at scale. You will set technical direction, mentor engineering teams, and ensure best practices for performance, security, and cost-effectiveness in our cloud-based data ecosystem. You will collaborate with cross-functional teams to deliver high-quality, robust, and scalable solutions that empower our customers to manage and analyze their data effectively. You will have deep expertise in designing, building, and optimizing modern, scalable data platforms on AWS, MS SQL Server and MongoDB. You will set technical direction, mentor engineering teams, and ensure best practices for performance, security, and cost-effectiveness in our cloud-based data ecosystem.
Our goal is evaluate, plan, and execute the evolution of our legacy data architecture to a more modern approach, allowing deprecation of legacy applications and empowering our new SaaS solutions.
What you will do:
• Design and implement end-to-end data architectures on AWS, including data lakes, data warehouses, real-time streaming pipelines, and ETL/ELT processes.
• Very strong data engineering experience working with AWS Tech Stack with a focus on building complex self healing data engineering pipelines, cloud delta lakes and migrating legacy technology stack to the Cloud
• Extensive experience with reverse engineering legacy stored procedures into data pipelines built using AWS Glue would be an added advantage
• Lead the design of data models, storage solutions, and access patterns that support analytical and operational workloads. Deep understanding of data modeling in Postgres db environments. Ability to reverse engineer legacy data models and redesign with foundational architectural principles including normalization, cardinality and ACID into Postgres databases like Aurora is critical.
• This role requires deep technical expertise, strong communication skills, and the ability to lead complex initiatives across multiple teams. Experience working on multiple projects simultaneously while troubleshooting technical issues and working with cross-functional stakeholders while communicating effectively to influence external engineering teams, product development teams, Business stakeholders and external partners.
• Act as a trusted advisor to stakeholders, bridging business needs with technical execution, and ensuring best practices in cloud architecture, security, and cost optimization. Work closely with our application architects, data scientists and data engineering teams to develop, enhance and define new data integrations and BI solutions.
• Mentor and guide engineering teams in implementing AWS services effectively and efficiently. Stay current with AWS service offerings and emerging cloud technologies, and recommend adoption where appropriate.
• Experience migrating SSIS, SQL Server and other legacy platform to AWS Cloud
• Optimize AWS workloads for performance, scalability and cost efficiency, leveraging tools like Trusted Advisor, Well-Architected Framework, and Cost Explorer.
• Deep experience with services such as:
• Storage & Compute: S3, EMR, Glue, Redshift, Athena, Lambda, EC2, EKS
• Streaming & Messaging: Kinesis, Kafka, MSK, SNS/SQS
• Orchestration & Workflow: Step Functions, Airflow, Data Pipeline
• Databases: Aurora Postgres, MongoDB, MS SQL Server
• Mentor and coach junior engineers, fostering a culture of technical excellence and continuous improvement to mature Data Engineering practices enterprise wide. Deliver TechTalks and training sessions on a regular basis.
• Previous experience in the Auto Industry would be a significant added advantage
What you will need:
• At least 10 or more years of experience working in the data engineering field as a Senior Data Engineer with at least 4 years designing and implementing solutions on AWS
• Solid understanding of SaaS, distributed systems, scalability, and high availability concepts.
• Previous experience mentoring junior data engineers, providing technical expertise, code reviews, and sharing best practices to foster professional growth.
• Excellent problem-solving skills and the ability to navigate complex technical challenges.
• Strong communication skills and the ability to collaborate effectively in cross-functional teams.
• Experience with hybrid cloud and multi-cloud strategies
• Familiarity with other cloud platforms (Azure, GCP)
• Hands-on coding/scripting in Python, Bash, or similar
Key Competencies:
• Strategic mindset with a strong business acumen
• Ability to balance short-term needs with long-term vision
• Problem-solving and analytical skills
• Continuous learner who stays ahead of cloud trends
Our Values
Trust & Transparency | People First | Positive Experiences | Calm Persistence | Never Settling
At ACV, we are committed to an inclusive culture in which every individual is welcomed and empowered to celebrate their true selves. We achieve this by fostering a work environment of acceptance and understanding that is free from discrimination. ACV is committed to being an equal opportunity employer regardless of sex, race, creed, color, religion, marital status, national origin, age, pregnancy, sexual orientation, gender, gender identity, gender expression, genetic information, disability, military status, status as a veteran, or any other protected characteristic. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you have a disability or special need that requires reasonable accommodation, please let us know.
For information on our collection and use of your personal information, please see our Privacy Notice.
No immigration or work visa sponsorship provided for this position.
Compensation: The compensation range for this position is listed in the "Job Details" section at the bottom of this posting. Please note that final compensation will be determined based upon the applicant's relevant experience, skillset, location, business needs, market demands, and other factors as permitted by law.