Senior Data Engineer
United States of America
Full Time
3 hours ago
$135,000 - $165,000 USD
Visa Sponsor
Key skills
PythonSQLCloud environmentsWorkflow orchestration toolsData modelingETL developmentData warehousingUnit testingSource controlData qualityAutomationScalable systemsLarge datasetsDevOpsContainerizationInfrastructure-as-codeCloud securityGovernanceCost optimizationAPI developmentML pipelinesLLM modelsPredictive analyticsEarly childhood education dataMLLLMETLData WarehousingAnalyticsUnit TestingSource ControlAgileCommunicationCollaborationCloud Security
About this role
Third Sector Intelligence (3Si) is a mission-driven company that provides data and analytics solutions to support early childhood education programs. They are seeking a passionate and talented Senior Data Engineer to build and maintain robust data pipelines, automate operational tasks, and improve data quality while collaborating with cross-functional teams.
Responsibilities:
- Design, build, and maintain robust and scalable data pipelines using Python and SQL
- Contribute to the development of a modular platform architecture that supports client-specific customizations while maintaining a clean and efficient core system
- Develop and implement automation for routine operational tasks, such as data ingestion and configuration management. This includes automating manual data uploading processes
- Develop and maintain a comprehensive unit testing framework for ETL processes and data transformations to ensure data quality
- Implement comprehensive logging, monitoring, and alerting mechanisms for all ETL processes and data transformations
- Work directly with clients and cross-functional teams; strong communication skills and professionalism are essential
- Provide guidance and mentorship to junior engineers to enhance their technical skills
Requirements:
- 5+ years of experience as a Data Engineer or in a similar role
- Strong programming skills in Python and SQL
- Experience working with cloud environments for data storage, processing, and deployment
- Experience with workflow orchestration tools
- Experience with data modeling, ETL development, and data warehousing
- Experience with unit testing and source control
- Excellent communication and collaboration skills, including the ability to communicate technical concepts to non-technical audiences
- Ability to work independently and as part of an agile team
- Passion for data quality, automation, and building scalable systems
- Experience working with large datasets from diverse sources
- Ability to effectively prioritize tasks and manage time to meet deadlines
- Strong problem-solving skills and a desire to learn and grow professionally
- DevOps experience, including containerization and infrastructure-as-code
- Understanding of cloud security, governance, and cost optimization
- Experience building and maintaining APIs that facilitate data movement across systems
- Experience developing and deploying ML pipelines, LLM models, and predictive analytics solutions
- Experience working with early childhood education data