Change Details

CCC's rcwatcher task has been tagging fixed images as corrupt. As a result, I have shutdown the bot entirely pending investigation. Some investigation revealed that the redis queue is currently 490,252 entries long and currently still processing uploads from [[ https://commons.wikimedia.org/w/index.php?title=File:The_University_of_North_Carolina_Catalogue_(1898)_-_DPLA_-_1de5a05812ab863560f119e3dfd2911f_(page_65).jpg&oldid=394035601 | Feb 12 ]]. The crashes //really// hurt the bot's effectiveness. A new check needs to be added for cases like this and -- ideally -- an automated process developed to spin up (and down) workers dynamically.

CCC's rcwatcher task has been tagging fixed images as corrupt (though not updating the database entries). As a result, I have shutdown the bot entirely pending investigation. Some investigation revealed that the redis queue is currently 490,252 entries long and currently still processing uploads from [[ https://commons.wikimedia.org/w/index.php?title=File:The_University_of_North_Carolina_Catalogue_(1898)_-_DPLA_-_1de5a05812ab863560f119e3dfd2911f_(page_65).jpg&oldid=394035601 | Feb 12 ]]. The crashes //really// hurt the bot's effectiveness. A new check needs to be added for cases like this and -- ideally -- an automated process developed to spin up (and down) workers dynamically.

CCC's rcwatcher task has been tagging fixed images as corrupt (though not updating the database entries). As a result, I have shutdown the bot entirely pending investigation. Some investigation revealed that the redis queue is currently 490,252 entries long and currently still processing uploads from [[ https://commons.wikimedia.org/w/index.php?title=File:The_University_of_North_Carolina_Catalogue_(1898)_-_DPLA_-_1de5a05812ab863560f119e3dfd2911f_(page_65).jpg&oldid=394035601 | Feb 12 ]]. The crashes //really// hurt the bot's effectiveness. A new check needs to be added for cases like this and -- ideally -- an automated process developed to spin up (and down) workers dynamically.