A set of generic methods and ideas to design a sturdy, cost-efficient, and scalable knowledge mannequin on your post-modern knowledge stack.
Over the previous few years, because the Fashionable Information Stack (MDS) launched new patterns and requirements for transferring, reworking, and interacting with knowledge, dimensional knowledge modeling progressively grew to become a relic of the previous. As an alternative, knowledge groups relied on One-Massive-Tables (OBT) and stacking layer upon layer of dbt fashions to deal with new use circumstances. Nonetheless, these approaches led to unlucky conditions during which knowledge groups grew to become a value middle with unscalable processes. So, as we enter a “post-modern” knowledge stack period, outlined by the pursuit to cut back prices, tidy up knowledge platforms, and restrict mannequin sprawl, knowledge modeling is witnessing a resurrection.
This transition places knowledge groups in entrance of a dilemma: ought to we revert again to strict knowledge modeling approaches that had been outlined many years in the past for a totally completely different knowledge ecosystem, or can we introduce new ideas which might be outlined primarily based on as we speak’s know-how and enterprise issues?
I imagine that, for many firms, the best reply lies someplace within the center. On this article, I’ll talk about a set of information modeling requirements to maneuver away from…