Data Engineer

GigFinder.ai is seeking a Data Engineer for a US-based FinTech client. The role focuses on designing and building scalable batch and streaming data pipelines, processing large datasets, ensuring data quality, and preparing data for analytics while making architectural decisions.

Responsibilities:

• Design and build data pipelines (batch or streaming), process large volumes of data, ensure data validation, deduplication, and consistency, ingest data from files, cloud storage, or streams, prepare data for analytics, make architectural decisions

Requirements:

• novice in: Data Quality
• beginner in: Big Data, Data Pipelines
• competent in: ETL, Data Engineering, SQL, Pipeline, JAVA
• Strong Data Engineering experience, SQL and database knowledge, experience with ETL, batch or streaming processing, programming skills in Java or similar, pipeline design skills, and ability to explain architectural decisions
• novice in: GCP, AI, AWS, Cloud Platforms, Azure
• beginner in: FinTech, Kafka, Elasticsearch, Real-Time Processing, Cloud Storage, Redis, B2B