Data Engineer

SoftStandard Solutions is seeking a Senior Data Engineer to design and maintain scalable data pipelines. The role involves collaborating with various teams to ensure reliable data products and implementing best practices for data governance and quality.

Responsibilities:

• Design, build, and maintain scalable and reliable data pipelines for batch and real-time data processing
• Architect and manage modern data lake, data warehouse, and lakehouse solutions across cloud platforms
• Develop and maintain ETL/ELT workflows to ingest, transform, and deliver data to downstream consumers
• Optimize data models, schemas, and query performance for large-scale analytical workloads
• Collaborate with data scientists, ML engineers, and business analysts to deliver clean, reliable data products
• Implement data quality checks, validation frameworks, and observability tooling across pipelines
• Build and maintain streaming data solutions using Kafka, Spark Streaming, or Flink
• Enforce data governance, lineage tracking, and security best practices across all data assets
• Support CI/CD for data pipelines and infrastructure using modern DevOps practices

Requirements:

• 8-9 Years of experience in data engineering or software engineering
• 4+ years of hands-on experience designing and maintaining production-grade data pipelines
• Strong expertise in at least one major cloud platform — AWS, GCP, or Azure
• Deep knowledge of distributed computing and large-scale data processing using Spark
• Experience with both batch and real-time streaming data architectures
• Degree in Computer Science, Engineering, Mathematics, or equivalent practical experience
• Scala