PanAgora Asset Management is seeking a Data Engineer to design, build, and maintain data infrastructure and ingestion frameworks. The role involves collaborating with cross-functional teams to implement scalable data solutions on AWS that support data-driven reporting across the organization.
Responsibilities:
- Design, develop, and maintain scalable data and file ingestion frameworks
- Collaborate with cross-functional value stream teams, analysts, and business stakeholders to understand and refine data requirements and translate them into technical solutions
- Optimize data ingestion frameworks for performance and reliability
- Follow data governance and security best practices
- Troubleshoot data integrity and performance issues
- Participate in code reviews and enforce coding standards
- Participate in architectural decisions and design discussions
- Work on initiatives to mitigate and alleviate core data application issues, including opportunities for process automation
- Stay updated with the latest trends and technologies in data engineering and apply them to improve the data framework
- Collaborate with colleagues on development best practices and data application issues
- Operate independently with some latitude for unreviewed actions or decisions
- Complete other duties as assigned
Requirements:
- Bachelor's degree in computer science or a related field, such as Information Systems, Mathematics, or Software Engineering, or an equivalent combination of training and experience
- 2 to 4 years of software development experience, preferably in a data-related field
- Experience with ETL development and design using Python and Big Data technologies, including Hadoop and Spark
- SQL knowledge and RDBMS experience with a recognized database, such as Aurora, MySQL, Postgres, or Redshift
- Experience with the AWS platform
- Understanding of dimensional models and ER designs
- Strong written and verbal communication skills
- Knowledge of SDLC and Agile methodology
- Exposure to data warehouse principles
- Ability to communicate in a friendly and professional manner with customers and colleagues, remain calm in stressful situations, independently troubleshoot program errors regardless of technology, and write user-friendly explanations of highly technical functionality
- 2 years of IT experience in financial services or another highly regulated industry
- Use of JIRA in Agile development
- Knowledge of DevOps and CI/CD best practices
- Experience with new technologies such as QuickSight and Co-Pilot
- Customer focus, including delivering internal and external customer service excellence, listening skills, patience, empathy, authenticity, proactivity, and perseverance
- Ability to build partnerships through collaborative relationships, effective conflict management, trust-building, integrity, respectful communication, and support for the success of others