AI Data Engineer (Python & Azure)

job summary:

Join an applied science team dedicated to bridging research, innovation, and production to develop and train cutting-edge AI models for next-generation operating systems and devices. We are seeking a hands-on Data Pipeline Engineer to design, build, and operate Python-based workflows that transform massive document and text datasets into clean, training-ready data.

location: Redmond, Washington

job type: Contract

salary: $76.96 - 85.96 per hour

work hours: 8am to 5pm

education: Bachelors



responsibilities:

• Develop, maintain, and optimize Python pipelines for data ingestion, OCR processing, text extraction, cleaning, normalization, and deduplication.
• Run, monitor, and troubleshoot large-scale batch processing jobs; build automated retry, error handling, and recovery mechanisms.
• Implement automated quality checks to flag corrupted files, incomplete OCR outputs, duplicates, formatting flaws, and metadata discrepancies.
• Filter, segment, tokenize, and format training-ready text and document datasets.
• Manage bulk uploads, downloads, and synchronization between local processing environments and Azure cloud storage while verifying data integrity.
• Organize raw, intermediate, and published datasets with consistent versioning, naming conventions, and source lineage.
• Optimize processing throughput, memory utilization, storage footprints, and cloud computing costs across batch and distributed architectures.
• Collaborate closely with applied scientists and AI model training teams to convert data specifications into repeatable pipeline workflows.
• Deliver well-documented, tested, and version-controlled code adhering to corporate security and data governance standards.

qualifications:

REQUIRED QUALIFICATIONS

5+ years of hands-on data engineering, data pipeline development, or data science experience with strong production coding responsibilities.

Demonstrated hands-on experience building large datasets from the ground up (not just working with pre-existing datasets).

Advanced Python programming skills, including building modular code, testing, debugging, and robust exception handling.

Direct experience handling and processing large structured and unstructured datasets that exceed single-machine memory using parallel, distributed, or memory-efficient approaches.

Practical experience managing cloud storage workflows in Microsoft Azure (Azure Blob Storage or Azure Data Lake Storage), including bulk data transfer and integrity validation.

Working proficiency with Python data tools and formats (pandas, NumPy, JSON/JSONL, CSV, Parquet) as well as SQL, Linux CLI, and Git.

Must be able to work 100% onsite (Monday - Friday, 40 hours/week) in Puget Sound, WA.

PREFERRED QUALIFICATIONS

Experience building or running OCR pipelines, processing scanned documents, multilingual text, or complex document layouts.

skills:

Azure Data Factory,Azure Data Lake Storage,Azure Machine Learning,batch processing,Azure Blob Storage,command-line tools,containerized environments,CI/CD,data cleaning,deduplication,data ingestion,data integrity,logging,data-related,Data Pipeline,data pipeline development,data-processing,data access,Azure Databricks,distributed processing,Git,Hugging Face,data engineering,computer science,JSON,Linux environments,AI model training,versioning,metadata,Azure storage,Windows,NumPy,pandas,Parquet,Python-based,Python,proficiency in Python,raw data,debugging,knowledge of SQL,unstructured datasets,ability to communicate,Organize,Strong troubleshooting skills,applied science,data quality,data science,governance,innovation,mathematics,statistics,multilingual,normalization,quality checks,quality metrics,reproducibility,investigate,security,testing,workflows

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact

Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.