Senior Data Engineer
Burlington, North Carolina, United States of America
Contract
1 day ago
$100,000 USD
Key skills
PythonJavaSQLAIMLNLPNatural Language ProcessingGenAIETLELTData EngineeringData LakeAnalyticsSnowflakeSparkKafkaAzureAzure FunctionsOracleRESTfulGitHubSource ControlAgileCI/CDMentoringPrototypingCommunicationCollaboration
About this role
Location: Burlington, NJ Salary: $100,000.00 USD Annually - $110,000.00 USD Annually Description:
Position: Data Engineer
Location: Burlington NJ 08016 (Hybrid)
Position Overview
Come join our growing team of data practitioners and be on the leading edge of Client's digital transformation. Client is seeking a self-driven and highly motivated individual to join a dynamic team with a passion for data, software, and engineering. At client you will have the opportunity to work with the latest technologies in a goal-oriented environment. The Senior Data Engineer is a member of the Enterprise Data and Analytics team supporting business areas including Merchandising, Allocations, Marketing, IT and Supply Chain Analytics teams with insights gained from analyzing Burlington and external data. The successful candidate will have strong experience pulling data from various internal and external data sources and preparing it for advanced analytics, segmentation, and modeling. Must have strong interpersonal and relationship building skills as well as written and verbal communication skills.
You'll Come With
By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.
Contact:
This job and many more are available through The Judge Group. Please apply with us today!
Position: Data Engineer
Location: Burlington NJ 08016 (Hybrid)
Position Overview
Come join our growing team of data practitioners and be on the leading edge of Client's digital transformation. Client is seeking a self-driven and highly motivated individual to join a dynamic team with a passion for data, software, and engineering. At client you will have the opportunity to work with the latest technologies in a goal-oriented environment. The Senior Data Engineer is a member of the Enterprise Data and Analytics team supporting business areas including Merchandising, Allocations, Marketing, IT and Supply Chain Analytics teams with insights gained from analyzing Burlington and external data. The successful candidate will have strong experience pulling data from various internal and external data sources and preparing it for advanced analytics, segmentation, and modeling. Must have strong interpersonal and relationship building skills as well as written and verbal communication skills.
You'll Come With
- Design and Develop ETL to extract data from first and third-party data sources, stitch, and wrangle it for advanced analytics activities and AI/ML and GenAI uses.
- Guide and lead development of data pipelines to enable real-time, high volume, data consumption.
- Leverage data engineering best practices and tools in collaboration with analytics translators, data scientists, and cloud engineers
- Assist with researching first and third-party data sources to enable access and ensure availability of relevant data sources for those who need it
- Provide input to cloud engineers for the design and implementation of data management and/or architecture solutions
- Provide ongoing operational support for ETL/ELT environments including development, test, and production
- Design, implement, and deploy data loaders to load data into the cloud data platform
- Assist in pulling, filtering, tagging, joining, parsing, and normalizing data sets for use
- Mentoring junior members of the team
- Bachelor's or Master's degree in Computer Science / Engineering, Informatics, or related areas.
- 5+ years of experience in designing and implementing large scale data loading, manipulation, processing, analysis, and exploration solutions
- Extensive experience developing SQL based data processing
- 5+ years of experience with Data Architecture, Data Warehouse, Lake Houses, Data Lake, Data Marts and Data Stores with focus on AI/ML techniques and LLMs
- Experience with Snowflake and Oracle Databases as well as Azure and ADLS.
- Experience in development & provisioning RESTful APIs to enable real-time data consumption.
- Experience with source control tools such as GitHub and related CI/CD processes.
- Technical expertise with pulling and massaging data
- Great understanding of first/third party data
- Agile Development methodology
- Database Normalization
- Advanced SQL skills
- Understanding of data management principles and processes
- Passion for data, analytics and pushing business innovation
- Strategic thinker who loves technology and innovation
- Excellent communication skills
- AI-based development for data workflows, data wrangling, and code-assist
- Experience with Informatica IDMC
- Experience with GenAI and Natural Language Processing (NLP) frameworks
- Experience with real-time and streaming technology (i.e. Azure Event Hubs, Azure Functions Kafka, Spark Streaming)
- Unix / Linux Experience
- Experience with CI/CD practices
- Previous experience with DevOps
- Experience with Python / Java programming languages
- Experience with one or more enterprise scheduler
- Experience with AI-based testing, experimentation, and prototyping
- Retail or CPG experience preferred
By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.
Contact:
This job and many more are available through The Judge Group. Please apply with us today!