Make RSS item check incremental (improve Dailysearcher performance)

fernandog asked for this feature about 6 years ago — 4 comments

WebSpider commented about 6 years ago

This would only be possible for providers that allow us to get deltas

| fernandog commented about 6 years ago Admin

We have the lastSearch field in the DB. Maybe we can compare with dateadded in xml

| gborri commented about 6 years ago

In the back ThePirateBay version the daily search worked in a different way. It download RSS page (is always a delta) or get information from the provider homepage (either in this case is delta) and then look for it on SR in order to see if it is a show that SR managed. This way was more efficent.

Join the discussion!

with GitHub to comment