Page MenuHomePhabricator

CCC: corrupt.py always restarts at the beginning
Closed, ResolvedPublic

Description

Whenever corrupt.py is restarted, it starts at the beginning and must loop through all of the previous images it has scanned,, comparing in the local database to see if it has seen it. This could conceivably have negative consequences (time and local database queries) as it processes increasingly large image sets. Perhaps some sort of a counter should be created where it counts how many times it has identified that it has seen an image previously so that it could skip the database queries on the next run?

This, of course, would be a parameter configurable at runtime as it is also conceivable that re-checking everything would also be desired at times.

Revisions and Commits

Event Timeline

TheSandDoctor created this task.
TheSandDoctor created this object with visibility "Public (No Login Required)".
TheSandDoctor added a commit: Restricted Diffusion Commit.Feb 9 2020, 12:15 PM
TheSandDoctor added a commit: Restricted Diffusion Commit.Feb 9 2020, 5:56 PM
TheSandDoctor added a commit: Restricted Diffusion Commit.
TheSandDoctor added a commit: Restricted Diffusion Commit.Feb 9 2020, 6:29 PM
TheSandDoctor added a commit: Restricted Diffusion Commit.Feb 9 2020, 6:37 PM
TheSandDoctor added a commit: Restricted Diffusion Commit.
TheSandDoctor added a commit: Restricted Diffusion Commit.Feb 9 2020, 8:42 PM
TheSandDoctor added a commit: Restricted Diffusion Commit.