Article: Understanding the Data Mesh

Data, Decentralized Internet

Understanding the Data Mesh

Once data is treated as a product, it quickly becomes evident that a centralized model will never work. Instead, data products must be built in a decentralized way by the teams that own the data.

Much like a modern service stack is decentralized with hundreds or even thousands of services owned by multiple teams building their own APIs, Riccomini thinks a similar model can make a data mesh architecture a reality.

“A data mesh takes service stack best-practices and applies them to the data layer. Not only should application development teams define APIs for their business logic (in the form of web services); they should do so for their data as well. The infrastructure and culture needed for the two are remarkably similar,” he writes.

Read full article

Article: Data Mesh: Moving Away From Monolithic & Centralised Data Lakes

Cloud, Data, Decentralized Internet

Data Mesh: Moving Away From Monolithic & Centralised Data Lakes

Data mesh is a highly decentralised data architecture to solve challenges such as lack of ownership of data, lack of quality data and removing bottlenecks to encourage organisational scaling.

The goal of data mesh is to treat data as a product, with each source having a data product owner, who could ideally be part of the cross-functional team of data engineers. Despite having a separate owner, the data should be domain-focused and should have an autonomous offering that leads to a domain-driven distributed architecture.

Read full article