vesoft-inc/nebula

Support checkpointing a large query execution to disks and allow it to be resumed later

Open

#5,729 opened on Sep 27, 2023

View on GitHub
 (5 comments) (1 reaction) (0 assignees)C++ (1,144 forks)batch import
hacktoberfesttype/feature req

Repository metrics

Stars
 (9,828 stars)
PR merge metrics
 (No merged PRs in 30d)

Description

Suppose we have a long running query, we may want to pause it for a while, store its progress in disks as a checkpoint and come back to its execution later. This would benefit scenarios where we do not have sufficient resources for a large number of concurrent queries and we don't want to loose any progresses.

Contributor guide

Research direction
Investigate the query execution engine and how to serialize the execution state to disk. Look into existing checkpoint mechanisms in the codebase and design a resumption plan.
Tech stack
cpp
Domain
backenddatabasedistributed systems
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
4
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
Over 1 week
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
C++Git
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
20