Job Title: DataBricks Developer
Location: 100% Remote Work
Description:
Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or AWS Databricks.
Required Skills:
Extensive hands-on experience with Databricks and Apache Spark (PySpark, Scala, or SQL) - 8+ years of experience
Proficiency in at least one programming language (Python, Scala, or Java) - 5+ years of experience
Strong understanding of cloud data architectures (Azure Data Lake, AWS S3, Google Cloud Platform Storage) and related ecosystem - 5+ years of experience
Experience with CI/CD tools and DevOps practices for data engineering - 5+ years of experience
Familiarity with data warehousing concepts and tools (Delta Lake, SQL, etc.) - 5+ years of experience
Solid grasp of distributed computing, performance tuning, and big data best practices - 5+ years of experience
Excellent communication and problem-solving skills - 5+ years of experience
