Ad Hoc LLC is a technology company that empowers organizations to deliver scalable, impactful digital services. The Data Engineer III role involves building data infrastructure, pipelines, and systems while mentoring junior engineers and improving data engineering processes.
Responsibilities:
- Builds data infrastructure, pipelines, systems, and tools with a little feedback and guidance from their team
- Intermediate understanding of data management and transformation of raw data into interpretable information
- Ability to create accurate and accessible datasets for Data Analysts and Scientists to interpret and use
- Own maintenance of data architectures and systems
- Practices technical and communications skills to improve context knowledge and mentor junior data engineers
- Presents on and writes about their work to both internal and external parties
- Participates in planning sessions, building an understanding of data architectures and infrastructure
- Supports recruiting efforts by evaluating homework assignments and potentially assisting with interviews
Requirements:
- Bachelor's degree and 5+ years of experience
- Proficient with at least one family of data ingestion systems, cloud database services, and visualization software
- Background in key data concepts including constructing databases, processing big data, improving data accuracy, etc
- Strong experience with Python / Apache Spark
- Solid understanding of data modeling, ETL process, and distributed computing
- Strong understanding of software design patterns, data structures, and algorithms
- Related experience in analytic programming, data extraction, querying databases/data warehouses and data analysis
- AWS Experience (S3, EC2, Glue, Lambda, etc)
- R experience
- Professional Databricks/Apache Spark Certification(s)
- SAS experience