Title: Big Data Operations Engineer
Location: 100% Remote - Night shift schedule: Monday Friday, 11:00 PM 7:00 AM EST
Duration: 6 Months with possible extension
W2 and C2C
Job Summary:
Title: This position is for a mid-level support engineer responsible for supporting big data operations within AWS environments. The role includes support across AWS services, UNIX/Linux, Windows, SQL/Postgres databases, batch scheduling platforms, and enterprise infrastructure environments. The engineer will work with minimal supervision to maintain hybrid cloud and on-prem infrastructure while leveraging automation, containerization, DevOps practices, and AI-enabled operational tooling to improve reliability, scalability, and operational efficiency.
Essential Responsibilities
Big Data & Cloud Operations
Support large-scale AWS-based big data processing environments
Monitor batch processing, data pipelines, and execution workflows
Troubleshoot and remediate production issues and escalation activities
Execute SQL status queries and operational health checks
Support hybrid Linux and Windows environments
Automation & Scripting
Develop automation scripts using Python, Bash, PowerShell, or similar scripting languages
Build and maintain monitoring and operational automation tools
Support infrastructure-as-code and deployment automation initiatives
Cloud & Infrastructure Support
Operate and maintain AWS services including EC2, ECS, Lambda, CloudWatch, and IAM
Support Azure cloud services including Virtual Machines, Container Instances, Monitor, and Active Directory
Maintain reliability, availability, and serviceability through proactive monitoring and optimization
Batch Scheduling & Monitoring
Implement and manage enterprise job scheduling tools such as JAMS, AutoSys, or equivalent platforms
Resolve scheduling conflicts, failed jobs, and operational bottlenecks
Monitor infrastructure, containerized applications, and cloud resources using enterprise monitoring platforms
Systems Administration & CI/CD
Troubleshoot Linux and Windows operating systems, including patching and application deployment
Support CI/CD pipelines using Jenkins, GitLab, and Git-based deployment workflows
Assist with deployment troubleshooting and release support activities
Collaboration & Process Improvement
Partner with DevOps, Security, Infrastructure, and Application Development teams
Participate in operational process improvements focused on automation and modernization
Support Disaster Recovery (DR), Business Continuity Planning (BCP), and audit/compliance testing activities
Required Qualifications
Bachelor's degree in Computer Science, Information Systems, or related field (or equivalent experience)
8+ years of experience in systems administration, infrastructure support, or cloud operations
Experience supporting production environments
Strong SQL/database experience (Postgres, Oracle, or equivalent)
Experience with AWS cloud services and enterprise infrastructure operations
Hands-on scripting experience using Python, Bash, or PowerShell
Familiarity with CI/CD pipelines and DevOps tooling
Knowledge of enterprise monitoring and operational support practices
Strong troubleshooting and problem-solving skills
Ability to work independently in fast-paced operational environments
Strong communication and collaboration skills
