Job Summary
We are seeking a highly skilled Data & Edge Platform Engineer with expertise in Edge computing, broker systems, enterprise integration, and DataOps pipelines. The ideal candidate will design, build, and maintain scalable data systems and real-time pipelines leveraging modern programming languages such as Python and JavaScript.
This role involves working on distributed architectures, event-driven systems, and enterprise-grade data platforms to enable seamless data ingestion, processing, and delivery across edge and cloud environments.
________________________________________
Keywords : HiveMQ, MQTT Broker, Cedalo, Edge Broker, Highbyte, DataOPS
Key Responsibilities
Edge Computing & Distributed Systems
• Design and implement edge-based data processing solutions for low-latency and real-time analytics.
• Develop and deploy lightweight services on edge devices and gateways.
• Optimize data flow between edge, on-premise systems, and cloud platforms.
• Ensure resiliency, fault tolerance, and efficient resource utilization at the edge.
Broker & Enterprise Broker Systems (HiveMQ & Cedalo)
• Architect and manage message broker systems (e.g., HiveMQ, Cedalo).
• Build enterprise integration patterns using enterprise brokers or integration platforms.
• Implement event-driven architectures for real-time data streaming and ingestion.
• Monitor and tune broker performance for reliability and scalability.
Data Pipelines & Data Engineering
• Design and maintain end-to-end data pipelines for batch and streaming workloads.
• Develop ETL/ELT frameworks to transform and load data efficiently.
• Integrate structured and unstructured data sources across enterprise systems.
• Ensure data quality, consistency, and availability across pipelines.
DataOps & Automation (Highbyte)
• Implement DataOps practices including CI/CD for data pipelines.
• Automate data workflows, testing, validation, and deployments.
• Use orchestration tools (e.g., Airflow, Prefect) for pipeline scheduling and monitoring.
• Establish governance, lineage tracking, and observability for data systems.
Programming & Development
• Develop scalable backend systems using Python).
• Build APIs, microservices, and data processing modules.
• Use JavaScript (Node.js) for integration services, dashboards, or edge applications.
• Write clean, maintainable, and testable code following best practices.
________________________________________
Required Skills & Qualifications
• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
• 4+ years of experience in data engineering, distributed systems, or platform engineering.
• Strong proficiency in:
o Python (data processing, APIs, automation)
o JavaScript / Node.js
• Hands-on experience with:
o Message brokers: HiveMQ, Cedalo
o Protocols : Kafka, MQTT, RabbitMQ, etc.
o Data pipeline tools: Highbyte, Ignition, Airflow, Spark, Flink (preferred)
• Experience with cloud platforms (Azure, AWS, or GCP).
• Knowledge of containers and orchestration (Docker, Kubernetes).
• Familiarity with CI/CD pipelines and DevOps practices.
________________________________________
Preferred Qualifications
• Experience in setting up and building pipeline in HiveMQ, Cedalo & Highbyte
• Experience with edge computing frameworks (Azure IoT Edge, AWS Greengrass).
• Knowledge of stream processing frameworks (Kafka Streams, Apache Flink).
• Experience in real-time analytics and event-driven architectures.
• Exposure to data governance, lineage, and observability tools.
• Understanding of security practices for distributed systems.
________________________________________
Key Competencies
• Strong analytical and problem-solving skills.
• Ability to work in cross-functional teams and enterprise environments.
• Excellent communication and documentation skills.
• Proactive mindset with focus on innovation and optimization.
________________________________________
Tools & Technologies
• Languages: Python, JavaScript (Node.js)
• Messaging: HiveMQ, Cedalo, Highbyte
• Protocols : Kafka, MQTT, RabbitMQ
• Data Tools: Airflow, Spark, Flink
• Cloud: Azure / AWS / GCP
• DevOps: CI/CD pipelines, Docker, Kubernetes
• Monitoring: Prometheus, Grafana, ELK stack
________________________________________
Work Environment
• Agile and collaborative team environment.
• Opportunity to work on cutting-edge Edge + Data + AI ecosystems.
• Exposure to enterprise-scale data platforms and modern architectures.