The Dataflow Model Revisited

What happened

Eleven years ago, the Dataflow Model paper argued that unbounded, out-of-order data was the new normal, and that we must stop waiting for data to ever become complete. It proposed a unified model (windowing, triggers, watermarks, and retractions) for freely trading off correctness, latency, and cost across batch and streaming engines. On the occasion of its VLDB Test of Time award, we grade our own work—a paper abou…

Summary assembled by rule from the sources below

Timeline

1. 18:10
   First appeared on Hacker NewsHHacker News
2. 17:11
   Discussion started on LobstersLLobsters

Sources