streamcuts
Stream cuts are a concept used in distributed streaming storage systems to represent a boundary in a multi-segment stream. In these systems, a stream is divided into multiple logical segments that can grow independently. A stream cut encodes a consistent position across the set of segments, allowing reads and computations to proceed from a defined boundary even as segments are split or merged during scaling.
Formally, a stream cut is a map from segment identifiers to offsets within those segments. An offset
Usage and purpose: stream cuts are used to read from a stream starting at a particular boundary,
Relationship to offsets and checkpoints: unlike a single numeric offset, a stream cut provides per-segment positions,