SMB RecruitingRemote
Senior Data Engineer
United States of America
Full Time
2 hours ago
$115,000 - $150,000 USD
Visa Sponsor
Key skills
JavaSparkAWSKafkaAirflowSQLNoSQLPythonBashLinuxAgileMachine LearningPyTorchscikit-learnHadoopJUnitUnit TestingS3MySQLRedisElasticsearchPerformance Optimization
About this role
SMB Recruiting is seeking a passionate and skilled Senior Data Engineer who thrives on solving complex challenges and building scalable, high-performance systems. The role involves leveraging emerging technologies to build modern data pipelines and ensuring compliance with information security standards.
Requirements:
- 4+ years of software engineering experience with large-scale, multi-threaded, and distributed systems using Java
- Strong fundamentals in algorithms and data structures
- Deep understanding of distributed batch and streaming data processing systems (Spark, Hadoop, Kafka, ElasticSearch)
- Practical knowledge of workflow management tools (Airflow, Oozie) with scripting experience (Python, Bash)
- Confidence with handling data in both SQL and NoSQL databases (MySQL, Redis)
- Be an advocate for performance optimization, unit testing (JUnit, Mockito), and automation
- Experience with AWS cloud technologies (EMR, S3, MSK)
- Solid experience in the Linux environment
- Familiarity with Agile software development and best practices
- Knowledge of Machine Learning (PyTorch, Scikit-Learn) is a plus