Apache NiFi Data Engineer

Quantum World Technologies Inc. is seeking an Apache NiFi Data Engineer with extensive experience. The role involves designing and managing complex data flows, optimizing performance, and ensuring data integration security.

Responsibilities:

• Pipeline Development Design build and configure complex realtime or batch data flows and ETLELT pipelines using Apache NiFi
• Processor Customization Develop custom NiFi processors scripts and automation tools to handle unique data transformations
• Performance Optimization Monitor and tune NiFi data flows for maximum throughput efficiency and reliability
• Data Integration Security Integrate various data sources databases APIs streaming platforms while ensuring data security and compliance
• Troubleshooting Support Identify debug and resolve production issues within the NiFi environment

Requirements:

• Minimum 8+ years experience
• Strong experience with Apache NiFi designing managing and maintaining data flows
• Proficiency in Java for custom scripting
• Knowledge of ETLELT SQL and big data technologies Kafka Spark Hadoop
• Experience with Linux cloud platforms AWSAzure or containerization Docker Kubernetes