Data Modeler || Berkeley Heights, NJ (5days Onsite) || Contract
Main skills: Kafka, Flink, MongoDB, Spark Data Modeler
Role Overview
We are seeking a Big Data Modeler to design and optimize data schemas across our modern streaming and NoSQL ecosystem. You will bridge the gap between complex business requirements and high-performance technical execution, ensuring our platforms for real-time ingestion, stream processing, and document storage are scalable and governed
Responsibility:
Stream & Batch Modeling: Design conceptual, logical, and physical data models for streaming data platforms using Kafka and Flink
Distributed Processing Architecture: Architect data structures optimized for Spark batch processing and in-memory event streaming, ensuring data integrity and low latency.
NoSQL Data Modeling: Design flexible schemas, indexes, and aggregation pipelines in MongoDB to support high-speed, unstructured, and semi-structured application data.
Data Governance & Metadata: Establish data governance standards, metadata management, and data lineage for both event streams and historical data stores.
Performance Optimization: Collaborate with data engineers to tune data models for high-throughput, high-volume workloads and distributed computing constraints
Cross-functional Collaboration: Partner with software developers, data scientists, and business analysts to translate business use cases into scalable data strategies.
Qualification:
Experience: 5 to 8+ years of experience in data modeling, data warehousing, or big data architecture.
Core Technologies: Proven ability to model, design, and work with distributed data ecosystems:
Kafka: Designing event-driven architecture, topics, schemas, and event payloads.
Flink & Spark: Structuring data for stateful stream processing and large-scale batch ETL pipelines.
MongoDB: Document modeling, indexing strategies, and querying nested data structures.
Programming: Proficiency in SQL along with coding experience in Python, Java, or Scala.
Modeling Tools: Familiarity with modern data modeling and visualization tools (e.g., Hackolade, erwin).
Thanks, IT First Source
