Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix Deletion Script OOM #1676

Open
PeterChen13579 opened this issue Oct 2, 2024 · 0 comments · May be fixed by #1679
Open

Fix Deletion Script OOM #1676

PeterChen13579 opened this issue Oct 2, 2024 · 0 comments · May be fixed by #1679
Labels
bug Something isn't working
Milestone
2.3

Comments

@PeterChen13579
Copy link
Collaborator

PeterChen13579 commented Oct 2, 2024 •
edited
Loading

Summary

Deletion script currently stores all queries in memory before executing them, resulting in OOM if we delete millions of ledgers at a time. We should prevent this. Also good idea to add a file to support resume deletion from where it had left off in case of the program crashing
@PeterChen13579 PeterChen13579 added the bug Something isn't working label Oct 2, 2024
@PeterChen13579 PeterChen13579 added this to the 2.3 milestone Oct 2, 2024
@PeterChen13579 PeterChen13579 linked a pull request Oct 2, 2024 that will close this issue
Draft
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
Clio
Status: 📋 Backlog
Milestone
2.3
Development

Successfully merging a pull request may close this issue.

fix: deletion script will not OOM PeterChen13579/clio
1 participant
@PeterChen13579