Data Engineer III

American Express is hiring a Data Engineer III to design and optimize data architectures, pipelines, and database solutions. The role aligns data infrastructure with business needs and enterprise standards, supports cross-functional delivery, and implements Big Data management strategies.

Responsibilities:

• Advances the design and documentation of data architectures, ensuring seamless integration with existing systems and alignment with business requirements
• Develops, optimizes, and supports intricate data pipelines and database designs to meet advanced performance, scalability, and security needs
• Collaborates with delivery architects, engineers, and business teams to design optimal data tier solutions and support Agile development practices
• Ensures adherence to enterprise standards, guidelines, and policies, documenting processing requirements to maintain optimal data operations
• Identifies and adopts innovative technologies to enhance data infrastructure, maintaining detailed information about stored data and following data placement procedures
• Fosters a collaborative environment and contributes to the development of best practices and consistent development practices
• Executes Big Data management strategies by developing and optimizing partioning and indexing solutions
• Collaborates and co-creates effectively with teams in product and the business to align technology initiatives with business objectives

Requirements:

• Bachelor's degree in Computer Science, Computer Engineering, and/or comparable experience
• Knowledge of Big Data / NoSQL design and development with variety of data stores (document, column family, graph, etc.)
• Knowledge of database management system products and ecosystem - e.g., storage formats, access algorithms, data management processes, administration, data maintenance, replication, high availability, encryption, etc
• Knowledge of distributed (multi-tiered) systems, algorithms, and relational & non-relational databases
• Data engineering and development experience or a related job
• Experience in SQL and Python (or any other programming language like Java)
• Experience in design and development across one or more database management systems (e.g., HBase, Hive, GCP tools, NoSQL, BigTable, BigQuery, Spanner, IMS, DB2 zOS, Oracle, MS SQL Server, PostgreSQL, Netezza (PDA/DB2AA) as appropriate
• Experience in NoSQL databases (e.g., MongoDB, Couchbase, Cassandra, and Redis)
• Experience in data modeling tools (e.g., ErStudio, ErWin)
• Experience in performance tuning in the Big Data space
• Experience in distributed (multi-tiered) systems, algorithms, and application development
• Experience in database development and support of online transaction processing and/or online analytical processing systems
• Experience in software delivery methodology (Agile, Scrum, Agile XP, Test-Driven Development, Waterfall, etc.)
• Experience in infrastructure design for performance (e.g., network-attached or local-attached storage integration - such as Nutanix)
• advanced degree preferred