Data Engineer Junior or Senior
United States of America
Full Time
6 hours ago
$98,000 - $131,000 USD
No H1B
Key skills
PythonLinux Shell scriptingPrefectSnowflakeAWS S3AWS DynamoDBAWS CloudWatchAWS LambdaAWS SQSAzure OpenAI servicesTerraformGitHub ActionsAzure DevOpsCI/CD automationCloud PlatformsData streaming pipelinesAI/ML infrastructureShellAIMLOpenAIAgenticData EngineeringAWSAzureLambdaS3CloudWatchSQSGitHubGitOpsCI/CDSales
About this role
Progressive Technologies, Inc is dedicated to helping employees advance in their careers. They are seeking a Data Engineer, either at a junior or senior level, to support data scientists in AI/ML experiments that enhance personalization and sales in their quote funnel.
Responsibilities:
- Support a talented team of data scientists on Real Time Decisioning (RTD) AI/ML experiments that drive personalization and sales in the direct-to-consumer Progressive quote funnel
- Own the design and CI/CD deployment of our real time data pipelines, engineered ML model features and cloud infrastructure that support our business-owned ML model serving APIs
- Work hands on with our Business and IT partners to design the next generation of generative and agentic infrastructure for our business-built applications
Requirements:
- Bachelor's Degree or higher in an Information Technology discipline or related field of study and minimum of one year of work experience designing, programming, and supporting software programs or applications
- In lieu of degree, minimum of two years related work experience designing, programming, and supporting software programs or applications may be accepted
- Proficient in Python and Linux Shell scripting to build and support batch and real-time data streaming pipelines for use by ML/AI solutions (e.g., Prefect, Snowflake, AWS S3, AWS Dynamo DB)
- Familiar with supporting the AI model lifecycle by building and monitoring enterprise AI/ML infrastructure solutions leveraging Cloud Platforms (AWS CloudWatch, Lambda, SQS, Azure OpenAI services), Infrastructure as Code/GitOps tooling (e.g., Terraform), and CI/CD automation for real-time ML use cases (e.g., GitHub Actions, Azure DevOps)
- Strong verbal and written communications skills with the ability to translate technical information into understandable terms to a variety of audiences
- Passionate for innovating with cutting-edge technologies and owning end-to-end projects that evolve the data engineering landscape