HomeServices of AmericaRemote

Sr Data Integration Engineer

United States of America

Full Time

3 weeks ago

$156,000 - $182,000 USD

H1B Sponsor Likely

Key skills

RESTful APIsSQLPythonPowerShellCloud Platforms AzureCloud Platforms AWSCloud Platforms GCPCloud Data Tools ADFCloud Data Tools GlueCloud Data Tools Cloud Data FusionCloud Data Tools dbtCloud Data Tools AirflowCustomer Data Platforms SegmentCustomer Data Platforms Salesforce CDPCustomer Data Platforms Adobe Experience PlatformData Integration Tools Apache NiFiData Integration Tools TalendData Integration Tools InformaticaETL/ELT PipelinesData ModelingEvent-Driven Architecture, Kafka, Message Queues, and MicroservicesData Privacy and SecurityCI/CD and Infrastructure as Code BicepCI/CD and Infrastructure as Code TerraformCI/CD and Infrastructure as Code PulumiCI/CD and Infrastructure as Code CloudFormationData Warehousing and Analytics Platforms SnowflakeData Warehousing and Analytics Platforms BigQueryData Warehousing and Analytics Platforms DatabricksIdentity Resolution, Customer Segmentation, and Real-Time PersonalizationETLELTData EngineeringData WarehousingAnalyticsSnowflakeBigQueryDatabricksKafkaAirflowdbtAWSAzureGCPTerraformPulumiCloudFormationGlueRESTfulGitVersion ControlSalesforceCRMERPCI/CD

About this role

HomeServices of America is seeking a Sr. Data Integration Engineer to lead the design, development, and implementation of scalable data solutions. The role focuses on building a secure Customer Data Platform, developing API frameworks and data pipelines, optimizing cloud-based data environments, and ensuring data governance, privacy, and integration across enterprise systems.

Responsibilities:

Develop and maintain scalable data pipelines and workflows using Python and modern data tools
Build and maintain production-grade data integrations across internal and third-party systems
Code, test, deploy, orchestrate, monitor, document, and troubleshoot cloud-based data engineering processes and associated automation in accordance with best practices and security standards throughout the development lifecycle
Design and implement a robust, scalable Customer Data Platform (CDP) to centralize and unify customer data from multiple sources (CRM, ERP, web, mobile, etc.)
Develop and maintain APIs and data pipelines to support real-time and batch data integration between the CDP and internal/external systems
Optimize and manage data environments, including data modeling, security practices, and Lakehouse performance
Monitor and optimize data flows and API performance to ensure high availability and low latency
Troubleshoot and resolve data-related issues, ensuring system reliability and efficiency
Collaborate with cross-functional teams including marketing, product, engineering, and business stakeholders to define data requirements and integration strategies
Communicate effectively with stakeholders, translating technical concepts into actionable insights
Implement data governance and privacy practices to ensure compliance with regulations (e.g., GDPR, CCPA)
Ensure data quality, governance, and compliance with internal policies and external regulations
Utilize Git version control and CI/CD pipelines to deploy and manage data workflows
Evaluate and recommend tools, platforms, and technologies to support the CDP and integration framework
Document architecture, data flows, and integration patterns to support maintainability and scalability
Perform other duties as requested or as needed to fulfill the purpose of the job
Meet all performance and behavior expectations outlined in the company performance appraisal form or communicated by management
Perform responsibilities as directed achieving desired results within expected time frames and with a high degree of quality and professionalism
Establish and maintain positive and productive work relationships with all staff, customers and business partners
Demonstrate the behavioral and technical competencies necessary to effectively complete job responsibilities. Take personal initiative for technical and professional development
Follow the company HR Policy, the Code of Business Conduct and all subsidiary and department policies and procedures, including protecting confidential company information, attending work punctually and regularly, and following good safety practices in all activities

Requirements:

Bachelor's or Master's degree in computer science, engineering, or related field
10+ years of experience with RESTful APIs
10+ years of experience with SQL, Python, or PowerShell
5+ years of experience with cloud platforms such as Azure, AWS, GCP, ect
5+ years of experience with cloud-native tools (ADF, Glue, Cloud Data Fusion, dbt, Airflow)
Proven experience building or integrating with Customer Data Platforms such as Segment, Salesforce CDP, Adobe Experience Platform, or custom-built solutions
Experience with data integration tools such as Apache NiFi, Talend, Informatica, etc
Strong proficiency in ETL/ELT pipelines and data modeling
Familiarity with event-driven architectures, message queues (ex., Kafka), and microservices
Strong understanding of data privacy and security best practices
Familiarity with CI/CD pipelines and Infrastructure as Code (IaC) tools (Bicep, Terraform, Pulumi, CloudFormation)
Experience with identity resolution, customer segmentation, and real-time personalization use cases preferred
Knowledge of data warehousing and analytics platforms (ex. Snowflake, BigQuery, Databricks) preferred