Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(mango): rolling execution statistics (exploration) #4735

Closed
wants to merge 1 commit into from

Commits on Jan 10, 2024

  1. mango: rolling execution statistics

    In case of map-reduce views, the arrival of the `complete` message
    is not guaranteed for the view callback (at the shard) when a
    `stop` is issued during the aggregation (at the coordinator).  Due
    to that, internally collected shard-level statistics may not be
    fed back to the coordinator which can cause data loss hence
    inaccuracy in the overall execution statistics.
    
    Address this issue by switching to a "rolling" model where
    row-level statistics are immediately streamed back to the
    coordinator.  Support mixed-version cluster upgrades by activating
    this model only if requested through the map-reduce arguments and
    the given shard supports that.
    
    Fixes apache#4560
    pgj committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    2cb7139 View commit details
    Browse the repository at this point in the history