Real Soft IncRemote
Sr Data Engineer (fully remote)
United States of America
Contract
1 hour ago
H1B Sponsor Likely
Key skills
Data EngineeringData ModelingData Pipeline DevelopmentSQLPythonAzureDatabricksDelta Live TablesUnity CatalogData IntegrationData OrchestrationSnapLogicAzure Data FactoryJenkinsInfrastructure as CodeTerraformAPI IntegrationData Quality ObservabilitySodaVersion ControlGitHubCI/CDDimensional ModelingData WarehousingAgile MethodologyAgileCollaboration
About this role
Real Soft Inc is a company focused on data engineering solutions, and they are seeking a Senior Data Engineer to develop and optimize scalable data pipelines. The role requires expertise in SQL, Python, Azure, and Databricks, along with strong collaboration skills in an agile environment.
Responsibilities:
- Design and optimize API integration in pipelines
- Familiar with data quality observability tools such as Soda or similar
- Proficient in version control and CI/CD workflows using GitHub
- Advanced understanding of dimensional modeling and data warehousing concepts
- Comfortable leading efforts in agile environments and strong ownership and collaboration
Requirements:
- 5-9 years in data engineering, data modeling, and pipeline development
- Expert in SQL and Python for developing and debugging scalable data pipelines
- Deep hands-on experience with Azure and Databricks, including Delta Live Tables and Unity Catalog
- Skilled with data integration/orchestration tools (SnapLogic, Azure Data Factory, Jenkins)
- Strong use of infrastructure-as-code tools like Terraform to manage deployment pipelines
- Design and optimize API integration in pipelines
- Familiar with data quality observability tools such as Soda or similar
- Proficient in version control and CI/CD workflows using GitHub
- Advanced understanding of dimensional modeling and data warehousing concepts
- Comfortable leading efforts in agile environments and strong ownership and collaboration