Repository navigation
[Bulk Image Scraper] Option to add a delay between scrapes. #736
Description
Currently, rule34.xxx has been restricting traffic quite a bit because of scrapers, returning a "429: too many requests" error when trying to scrape tags. Adding a field to the options tab of the scraper to add a delay between each attempt should prevent this from happening.
Activity
godwinthehorny commentedon Jul 5, 2026
Alternatively, if someone could tell me how I would go about adding a pause/sleep function to the gelbooru-xpath.yml to make it do it for each one, that would be much appreciated. I can't seem to figure it out.
punamust commentedon Aug 29, 2026
There's currently a hardcoded 0.5s delay:
CommunityScripts/plugins/bulkImageScrape/bulkImageScrape.py
Line 353 in 1277b24
It could probably be made configurable via the UI, but you could just modify the plugin on-disk directly (and reload) to change it.