Newnovation Solutions is a tech-driven staffing and recruiting firm based in North America. They are seeking a talented Lead Software Engineer to build a high-speed Data Observability and Orchestration Pipeline Framework, contributing to the evolution of a next-generation technology platform capable of processing massive amounts of data.
Responsibilities:
- Architect and Lead the Data Highway Platform
- Design and develop scalable, high-performance, and reliable architectures for the Data platform using Go and Java
- Build event-driven, high-throughput systems capable of processing millions of events per second
- Implement real-time streaming and messaging systems using technologies such as Kafka
- Lead development and optimization of microservices to ensure scalability, performance, and security
- Collaborate with cross-functional teams to define technical vision, architecture roadmap, and platform strategy
- Drive AI Initiatives
- Architect and develop AI-powered components that enhance intelligence and automation within the Data Highway
- Integrate AI/ML models into real-time data processing systems
- Build AI-driven applications for observability, orchestration, and intelligent decision-making across large-scale distributed systems
- Hands-On Development
- Write clean, efficient, scalable, and maintainable GoLang code
- Develop RESTful APIs, distributed systems, and event-driven services
- Contribute directly to the implementation of DataBahn’s SaaS platform
- Conduct code reviews and mentor engineering teams on best practices, architecture, and coding standards
- Technical Leadership and Mentorship
- Provide technical leadership and mentorship to engineering teams
- Define architecture blueprints and scalable system designs
- Drive innovation by researching and implementing emerging tools, frameworks, and methodologies
- Guide teams in solving complex technical challenges and architectural decisions
- Platform Optimization
- Continuously improve platform performance, scalability, and reliability
- Implement performance tuning strategies including:
- Load balancing
- Caching
- Auto-scaling
- Design and develop self-healing systems with automated failure detection and recovery mechanisms
- Ensure high availability and minimal downtime across services
- Security and Compliance
- Implement robust security measures to ensure:
- Data integrity
- Confidentiality
- Compliance with industry standards
- Identify vulnerabilities and implement secure coding and architecture practices
- Ensure secure and efficient data flow across distributed systems
Requirements:
- Bachelor's, Master's, or PhD in Computer Science, Engineering, or a related field
- 8+ years of hands-on experience building SaaS-based software products and platforms
- 4+ years of hands-on experience with GoLang
- Proven expertise in architecting distributed systems, microservices, and event-driven platforms
- Experience building scalable, high-performance SaaS applications
- Strong expertise in GoLang
- Strong experience with Kafka
- Strong experience with JMS
- Strong experience with NATS
- Deep understanding of event-driven and real-time architectures
- Hands-on experience with AWS
- Hands-on experience with Azure
- Hands-on experience with GCP
- Strong experience with MySQL
- Strong experience with Redis / Memcached
- Strong understanding of CI/CD pipelines
- Strong understanding of Docker
- Strong understanding of Kubernetes
- Strong understanding of secure coding practices
- Strong understanding of vulnerability mitigation
- Strong understanding of compliance standards
- Java (preferred)
- Python (plus)
- Knowledge of NoSQL and distributed storage systems is a plus
- Excellent problem-solving and system design skills
- Strong logical thinking and architectural decision-making abilities
- Passion for scalable distributed systems and AI-driven applications
- Strong understanding of product lifecycle management and software delivery processes
- Ability to thrive in a fast-paced startup environment