Alana Marzoev, co-founder of Readyset, introduces partially stateful streaming dataflow as an innovative computational model for building efficient SQL caches. This approach allows SQL queries to be represented as long-running computational graphs, which can incrementally update outputs through data streams. Readyset's implementation of this model not only matches the performance of specialized caching systems but simplifies the overall process, alleviating the complexity of cache invalidation and application rewrites. The session includes a product demo and dives into the specifics of system architecture and usability.
At Readyset, we've been using this computational model to build a transparent database cache that has a performance profile that's on par with a hand-optimized, custom caching system.
The main idea is that you can represent SQL queries as these long running computational graphs, and stream data change updates through the graph to incrementally update the result that the graph emits.
Collection
[
|
...
]