Missing First Half of Season Posts

dannycorker · October 6, 2014, 10:30pm

OK, been using Drone for a while now, but have noticed a recurring problem. If a whole season gets posted in a higher quality than what I already have, it always seems to only catch the tail end of the releases. For example, I saw this in my log from earlier today:

After episodes 18 & 19 it went on and found the remainder of the season, but nothing from before episode 18 even though they were all uploaded at that time. An automatic search of the season later on this evening picked up all the episodes but many failed at that point, assumably due to takedown requests.

So my question is why did Drone miss episodes 1 -17? I can see it running the RSS check every 10 minutes all morning without ever noticing that anything was posted until episode 18 onwards. All episodes in the season were flagged for monitoring, and this isn’t the first time I’ve seen it happen. It also seems strange that the RSS returns 197 results every single time it runs - I thought it would find as many items as were posted in the last 10 minutes, which would be a different number each time?

If you’d like a fuller log or anything like that please just let me know what to do, first time I’ve posted on here. Thanks

markus101 · October 6, 2014, 10:35pm

It’s the last 100 results from your indexer, less anything drone can’t parse, so 2 indexers -3 that drone couldn’t parse gives you the 197. If the first 17 posts were bumped off the RSS before drone saw them it would explain it, but it would have to be a busy time, even during peak times it takes a while for them to be bumped.

If you do a manual search for one of the episodes it didn’t grab does drone show a reason why it was rejected?

Without debug logs there isn’t enough to see why it wasn’t grabbed. Debug logs will show why each release was rejected.

dannycorker · October 6, 2014, 10:53pm

Hi Markus - the manual search shows them all as fully available, no errors against them and hitting automatic search grabbed them straight away, although some did then go on to fail. I’ve turned on debug logging now so I guess I’ll have to wait for this issue to come up again.

If only the latest 100 results are returned, then I suppose you will always miss content if more than 100 releases are posted in the 10 minute window? If 4 shows have whole seasons uploaded at once you’d be over 100 already, so it could be that although I’d be surprised to see how often its happening (basically every time a blu ray comes out that improves on existing versions).

markus101 · October 7, 2014, 4:53pm

They would all have to be uploaded at the same time as well and the indexer find them all and update their RSS feed, its a worst case scenario, but relies on a number of perfectly timed issues. I think the likelihood is low, especially with RSS sync every 10 minutes.