>> |
04/15/11(Fri)05:14 No.25133675>>25133634 And it does this once every several hours. Assuming we have a dozen people following these threads, and all of them have to go back to, on average, page 5 to find the thread, that's 60 page requests, as opposed to the indexer which does 15, and then caches the results. In any case, if you knew anything about web scrapers you'd know that even the shittiest server isn't ever going to notice something scraping even 60 times a minute, the additional load is just tiny. Furthermore, it doesn't have to download every picture, just download every one matching the filesize of the marker, before it can hash it. This is a better way for everybody. |