PanAgora Asset Management is dedicated to transforming financial lives and providing a flexible work environment. The Data Engineer will design, build, and maintain the organization's data infrastructure, collaborating with cross-functional teams to implement scalable data solutions on AWS.
Responsibilities:
- Design, develop, and maintain a scalable data and file ingestion framework
- Collaborate with cross-functional value stream teams, analysts, and business stakeholders to understand and refine data requirements and translate them into technical solutions
- Optimize the data ingestion framework for performance and reliability
- Follow data governance and security best practices
- Troubleshoot data integrity and performance issues
- Participate in code reviews and enforce coding standards
- Participate in architectural decisions and design discussions
- Provide input and work on initiatives to mitigate and/or alleviate core data application issues, including opportunities for process automation
- Collaborate with colleagues on best practices and resolution of data application issues
- Stay current on data engineering trends and technologies and apply them to improve the data framework
- Operate independently with some latitude for un-reviewed actions or decisions
- Complete other duties as assigned
Requirements:
- Bachelor's degree in Computer Science or a related field (for example, Information Systems, Mathematics, Software Engineering) or an equivalent combination of training and experience
- 2–4 years of software development experience, preferably in a data-related field
- Experience with ETL development and design using Python and big data technologies (Hadoop and/or Spark)
- Strong SQL knowledge and RDBMS experience with a recognized database (for example, Aurora, MySQL, Postgres, Redshift)
- Experience on the AWS platform
- Understanding of dimensional modeling and ER designs
- Exposure to data warehouse principles
- Understanding of SDLC and Agile methodology
- Strong written and verbal communication skills
- Ability to communicate in a friendly and professional manner with customers and colleagues, remain calm in stressful situations, independently troubleshoot program errors regardless of technology, and write user-friendly explanations of technical functionality
- Ability to build collaborative and cooperative relationships, manage conflict effectively, and operate with integrity and respectful communication
- 2 years of IT experience in financial or other highly regulated industry
- Use of Jira in Agile development
- Knowledge of DevOps and CI/CD best practices
- Experience with new technologies such as QuickSight and Co-Pilot
- Customer focus and ability to deliver internal and external customer service excellence