Design, build, and optimize scalable data pipelines in Apache NiFi to automate ingestion, cleansing, and enrichment.
Architect and manage datasets on HDFS for high-volume storage.
Develop distributed processing workflows in PySpark and Hive.
Maintain and tune Postgres databases for high availability and performance.
Partner with Data Scientists to deliver clean datasets for model training.
Implement monitoring and alerting frameworks for pipeline health.

Bachelor’s degree in Computer Science, Information Technology, or related field (Master’s preferred).
Proven experience as a Data Engineer with expertise in HDFS, Apache NiFi, Hive, PySpark, Postgres, Python, and SQL.
Strong background in ETL/ELT design, distributed processing, and relational database management.
Experience with on-premises big data ecosystems supporting distributed computing.
Solid debugging, optimization, and performance tuning skills.
Ability to work in agile environments, collaborating with multi-disciplinary teams.
Strong communication skills for cross-functional technical discussions.

Data Engineer

Key skills