Duplicate downloads from autodl irssi

muddro · February 27, 2019, 12:15am

Sonarr version (exact version): 2.0.0.5301
Mono version (if Sonarr is not running on Windows):5.10.1.57
OS: FreeNAS 11.2
Debug logs:
**Description of issue

Torrent downloading some torrents twice

I have sonarr set up with irssi autodl. Through there I have a couple of sites it pushes to sonarr and downloads if it’s a hit. Recently sonarr has been approving the same torrent from two different sites. They are typically exactly the same torrent. Same episode last, show, release group, quality. However, torrent sizes May differ due to a sample being present or not. In any case I would figure once it starts, it should accept the same torrent, even if different size, unless it says proper or something. How can I stop this behavior?

markus101 · February 27, 2019, 1:04am

We’re going to need those debug logs that were requested when you opened this thread.

It’s most likely going to depend on what Sonarr has in it’s history/what information it’s received from the download client.

If the most recent event for that episode is a grab then Sonarr won’t grab another release for up to 12 hours (depends on whether that release meets the cutoff as well). If completed download handling is disabled then it’ll ignore indefinitely.

If the first was already imported Sonarr could grab the other if it imported it as a different quality. Size is not a contributing factor in accepting an upgrade.

muddro · February 27, 2019, 3:12am

Just happened again. Will edit the log slightly to mask torrent sites. Basically there is TS1, TS2, and TS3. It looks like it tried to push accept all 3. TS2 didnt go through, while TS1 and TS3 did. In This case. Please let me know if I got enough for you.

19-2-26 21:06:59.3|Info|ReleasePushModule|Release pushed: The Gifted S02E16 720p WEB x264-TBS - https://www.TS1.org/rss/download/1275678/(removed)/The%20Gifted%20S02E16%20720p%20WEB%20x264-TBS.torrent
19-2-26 21:06:59.3|Info|ReleasePushModule|Release pushed: The.Gifted.S02E16.720p.WEB.x264-TBS - https://www.TS2.org/download.php?id=1993205&name=The.Gifted.S02E16.720p.WEB.x264-TBS.torrent
19-2-26 21:06:59.3|Debug|ReleasePushModule|Push Release The Gifted S02E16 720p WEB x264-TBS not associated with an indexer.
19-2-26 21:06:59.3|Debug|ReleasePushModule|Push Release The.Gifted.S02E16.720p.WEB.x264-TBS not associated with an indexer.
19-2-26 21:06:59.3|Info|DownloadDecisionMaker|Processing 1 releases
19-2-26 21:06:59.3|Info|DownloadDecisionMaker|Processing 1 releases
19-2-26 21:06:59.3|Debug|DownloadDecisionMaker|Processing release 'The Gifted S02E16 720p WEB x264-TBS' from ''
19-2-26 21:06:59.3|Debug|DownloadDecisionMaker|Processing release 'The.Gifted.S02E16.720p.WEB.x264-TBS' from ''
19-2-26 21:06:59.3|Debug|Parser|Parsing string 'The Gifted S02E16 720p WEB x264-TBS'
19-2-26 21:06:59.3|Debug|Parser|Parsing string 'The.Gifted.S02E16.720p.WEB.x264-TBS'
19-2-26 21:06:59.3|Debug|Parser|Episode Parsed. The Gifted - S02E16 
19-2-26 21:06:59.3|Debug|Parser|Episode Parsed. The Gifted - S02E16 
19-2-26 21:06:59.3|Debug|Parser|Language parsed: English
19-2-26 21:06:59.3|Debug|Parser|Language parsed: English
19-2-26 21:06:59.3|Debug|QualityParser|Trying to parse quality for The Gifted S02E16 720p WEB x264-TBS
19-2-26 21:06:59.3|Debug|QualityParser|Trying to parse quality for The.Gifted.S02E16.720p.WEB.x264-TBS
19-2-26 21:06:59.3|Debug|Parser|Quality parsed: WEBDL-720p v1
19-2-26 21:06:59.3|Debug|Parser|Quality parsed: WEBDL-720p v1
19-2-26 21:06:59.3|Debug|Parser|Release Group parsed: TBS
19-2-26 21:06:59.3|Debug|Parser|Release Group parsed: TBS
19-2-26 21:06:59.3|Debug|AlreadyImportedSpecification|Skipping already imported check because CDH is disabled
19-2-26 21:06:59.3|Debug|AcceptableSizeSpecification|Beginning size check for: The.Gifted.S02E16.720p.WEB.x264-TBS
19-2-26 21:06:59.3|Debug|AlreadyImportedSpecification|Skipping already imported check because CDH is disabled
19-2-26 21:06:59.3|Debug|AcceptableSizeSpecification|Release has unknown size, skipping size check.
19-2-26 21:06:59.3|Info|ReleasePushModule|Release pushed: The.Gifted.S02E16.720p.WEB.x264-TBS - https://TS3/torrents.php?action=download&id=1180996&authkey=(removed)&torrent_pass=(removed)
19-2-26 21:06:59.3|Debug|AcceptableSizeSpecification|Beginning size check for: The Gifted S02E16 720p WEB x264-TBS
19-2-26 21:06:59.3|Debug|ReleasePushModule|Push Release The.Gifted.S02E16.720p.WEB.x264-TBS not associated with an indexer.
19-2-26 21:06:59.3|Debug|AcceptableSizeSpecification|Release has unknown size, skipping size check.
19-2-26 21:06:59.3|Debug|MaximumSizeSpecification|Maximum size is not set.
19-2-26 21:06:59.3|Info|DownloadDecisionMaker|Processing 1 releases
19-2-26 21:06:59.3|Debug|MaximumSizeSpecification|Maximum size is not set.
19-2-26 21:06:59.3|Debug|DownloadDecisionMaker|Processing release 'The.Gifted.S02E16.720p.WEB.x264-TBS' from ''
19-2-26 21:06:59.3|Debug|Parser|Parsing string 'The.Gifted.S02E16.720p.WEB.x264-TBS'
19-2-26 21:06:59.3|Debug|LanguageSpecification|Checking if report meets language requirements. English
19-2-26 21:06:59.3|Debug|Parser|Episode Parsed. The Gifted - S02E16 
19-2-26 21:06:59.3|Debug|ReleaseRestrictionsSpecification|Checking if release meets restrictions: The.Gifted.S02E16.720p.WEB.x264-TBS
19-2-26 21:06:59.3|Debug|LanguageSpecification|Checking if report meets language requirements. English
19-2-26 21:06:59.3|Info|ReleasePushModule|Release pushed: The Gifted S02E16 720p WEB x264-TBS - https://www.TS1.org/rss/download/1275678/(removed)/The%20Gifted%20S02E16%20720p%20WEB%20x264-TBS.torrent
19-2-26 21:06:59.3|Debug|Parser|Language parsed: English
19-2-26 21:06:59.3|Debug|ReleaseRestrictionsSpecification|Checking if release meets restrictions: The Gifted S02E16 720p WEB x264-TBS
19-2-26 21:06:59.3|Debug|ReleaseRestrictionsSpecification|[The.Gifted.S02E16.720p.WEB.x264-TBS] No restrictions apply, allowing
19-2-26 21:06:59.3|Debug|ReleasePushModule|Push Release The Gifted S02E16 720p WEB x264-TBS not associated with an indexer.
19-2-26 21:06:59.3|Debug|QualityParser|Trying to parse quality for The.Gifted.S02E16.720p.WEB.x264-TBS
19-2-26 21:06:59.3|Debug|QualityAllowedByProfileSpecification|Checking if report meets quality requirements. WEBDL-720p v1
19-2-26 21:06:59.3|Debug|ReleaseRestrictionsSpecification|[The Gifted S02E16 720p WEB x264-TBS] No restrictions apply, allowing
19-2-26 21:06:59.3|Info|DownloadDecisionMaker|Processing 1 releases
19-2-26 21:06:59.3|Debug|Parser|Quality parsed: WEBDL-720p v1
19-2-26 21:06:59.3|Debug|MinimumAgeSpecification|Not checking minimum age requirement for non-usenet report
19-2-26 21:06:59.3|Debug|QualityAllowedByProfileSpecification|Checking if report meets quality requirements. WEBDL-720p v1
19-2-26 21:06:59.3|Debug|DownloadDecisionMaker|Processing release 'The Gifted S02E16 720p WEB x264-TBS' from ''
19-2-26 21:06:59.3|Debug|Parser|Release Group parsed: TBS
19-2-26 21:06:59.3|Debug|RetentionSpecification|Not checking retention requirement for non-usenet report
19-2-26 21:06:59.3|Debug|MinimumAgeSpecification|Not checking minimum age requirement for non-usenet report
19-2-26 21:06:59.3|Debug|Parser|Parsing string 'The Gifted S02E16 720p WEB x264-TBS'
19-2-26 21:06:59.3|Debug|RetentionSpecification|Not checking retention requirement for non-usenet report
19-2-26 21:06:59.3|Debug|Parser|Episode Parsed. The Gifted - S02E16 
19-2-26 21:06:59.3|Debug|Parser|Language parsed: English
19-2-26 21:06:59.3|Debug|AlreadyImportedSpecification|Skipping already imported check because CDH is disabled
19-2-26 21:06:59.4|Debug|QualityParser|Trying to parse quality for The Gifted S02E16 720p WEB x264-TBS
19-2-26 21:06:59.4|Debug|AcceptableSizeSpecification|Beginning size check for: The.Gifted.S02E16.720p.WEB.x264-TBS
19-2-26 21:06:59.4|Debug|AcceptableSizeSpecification|Release has unknown size, skipping size check.
19-2-26 21:06:59.4|Debug|Parser|Quality parsed: WEBDL-720p v1
19-2-26 21:06:59.4|Debug|DelaySpecification|Profile does not require a waiting period before download for Torrent.
19-2-26 21:06:59.4|Debug|DelaySpecification|Profile does not require a waiting period before download for Torrent.
19-2-26 21:06:59.4|Debug|Parser|Release Group parsed: TBS
19-2-26 21:06:59.4|Debug|HistorySpecification|Performing history status check on report
19-2-26 21:06:59.4|Debug|MaximumSizeSpecification|Maximum size is not set.
19-2-26 21:06:59.4|Debug|HistorySpecification|Performing history status check on report
19-2-26 21:06:59.4|Debug|HistorySpecification|Checking current status of episode [15503] in history
19-2-26 21:06:59.4|Debug|HistorySpecification|Checking current status of episode [15503] in history
19-2-26 21:06:59.4|Debug|LanguageSpecification|Checking if report meets language requirements. English
19-2-26 21:06:59.4|Debug|ReleaseRestrictionsSpecification|Checking if release meets restrictions: The.Gifted.S02E16.720p.WEB.x264-TBS
19-2-26 21:06:59.4|Debug|DownloadDecisionMaker|Release accepted
19-2-26 21:06:59.4|Debug|DownloadDecisionMaker|Release accepted
19-2-26 21:06:59.4|Debug|ReleaseRestrictionsSpecification|[The.Gifted.S02E16.720p.WEB.x264-TBS] No restrictions apply, allowing
19-2-26 21:06:59.4|Debug|QualityAllowedByProfileSpecification|Checking if report meets quality requirements. WEBDL-720p v1
19-2-26 21:06:59.4|Debug|AlreadyImportedSpecification|Skipping already imported check because CDH is disabled
19-2-26 21:06:59.4|Debug|MinimumAgeSpecification|Not checking minimum age requirement for non-usenet report
19-2-26 21:06:59.4|Debug|AcceptableSizeSpecification|Beginning size check for: The Gifted S02E16 720p WEB x264-TBS
19-2-26 21:06:59.4|Debug|RetentionSpecification|Not checking retention requirement for non-usenet report
19-2-26 21:06:59.4|Debug|AcceptableSizeSpecification|Release has unknown size, skipping size check.
19-2-26 21:06:59.4|Debug|DelaySpecification|Profile does not require a waiting period before download for Torrent.
19-2-26 21:06:59.4|Debug|HistorySpecification|Performing history status check on report
19-2-26 21:06:59.4|Debug|HistorySpecification|Checking current status of episode [15503] in history
19-2-26 21:06:59.4|Debug|MaximumSizeSpecification|Maximum size is not set.
19-2-26 21:06:59.4|Debug|DownloadDecisionMaker|Release accepted
19-2-26 21:06:59.4|Debug|LanguageSpecification|Checking if report meets language requirements. English
19-2-26 21:06:59.4|Debug|ReleaseRestrictionsSpecification|Checking if release meets restrictions: The Gifted S02E16 720p WEB x264-TBS
19-2-26 21:06:59.4|Debug|ReleaseRestrictionsSpecification|[The Gifted S02E16 720p WEB x264-TBS] No restrictions apply, allowing
19-2-26 21:06:59.4|Debug|QualityAllowedByProfileSpecification|Checking if report meets quality requirements. WEBDL-720p v1
19-2-26 21:06:59.4|Debug|MinimumAgeSpecification|Not checking minimum age requirement for non-usenet report
19-2-26 21:06:59.4|Debug|RetentionSpecification|Not checking retention requirement for non-usenet report
19-2-26 21:06:59.4|Debug|DelaySpecification|Profile does not require a waiting period before download for Torrent.
19-2-26 21:06:59.4|Debug|HistorySpecification|Performing history status check on report
19-2-26 21:06:59.4|Debug|HistorySpecification|Checking current status of episode [15503] in history
19-2-26 21:06:59.4|Debug|DownloadDecisionMaker|Release accepted
19-2-26 21:07:04.7|Debug|QBittorrent|Downloading torrent for episode 'The Gifted S02E16 720p WEB x264-TBS' finished (23115 bytes from https://www.TS1.org/rss/download/1275678/(removed)/The%20Gifted%20S02E16%20720p%20WEB%20x264-TBS.torrent)
19-2-26 21:07:04.7|Debug|QBittorrent|Downloading torrent for episode 'The Gifted S02E16 720p WEB x264-TBS' finished (23115 bytes from https://www.TS1.org/rss/download/1275678/(removed)/The%20Gifted%20S02E16%20720p%20WEB%20x264-TBS.torrent)
19-2-26 21:07:04.9|Debug|QBittorrent|Downloading torrent for episode 'The.Gifted.S02E16.720p.WEB.x264-TBS' finished (23699 bytes from https://TS3/torrents.php?action=download&id=1180996&authkey=(removed)&torrent_pass=(removed)
19-2-26 21:07:05.0|Warn|ProcessDownloadDecisions|Couldn't add report to download queue. The Gifted S02E16 720p WEB x264-TBS

[v2.0.0.5301] NzbDrone.Core.Download.Clients.DownloadClientException: Download client failed to add torrent
  at NzbDrone.Core.Download.Clients.QBittorrent.QBittorrentProxy.AddTorrentFromFile (System.String fileName, System.Byte[] fileContent, NzbDrone.Core.Download.Clients.QBittorrent.QBittorrentSettings settings) [0x00080] in <db6accd1acca4b7b89f971b6407b53be>:0 
  at NzbDrone.Core.Download.Clients.QBittorrent.QBittorrent.AddFromTorrentFile (NzbDrone.Core.Parser.Model.RemoteEpisode remoteEpisode, System.String hash, System.String filename, System.Byte[] fileContent) [0x0000f] in <db6accd1acca4b7b89f971b6407b53be>:0 
  at NzbDrone.Core.Download.TorrentClientBase`1[TSettings].DownloadFromWebUrl (NzbDrone.Core.Parser.Model.RemoteEpisode remoteEpisode, System.String torrentUrl) [0x00208] in <db6accd1acca4b7b89f971b6407b53be>:0 
  at NzbDrone.Core.Download.TorrentClientBase`1[TSettings].Download (NzbDrone.Core.Parser.Model.RemoteEpisode remoteEpisode) [0x00148] in <db6accd1acca4b7b89f971b6407b53be>:0 
  at NzbDrone.Core.Download.DownloadService.DownloadReport (NzbDrone.Core.Parser.Model.RemoteEpisode remoteEpisode) [0x00191] in <db6accd1acca4b7b89f971b6407b53be>:0 
  at NzbDrone.Core.Download.ProcessDownloadDecisions.ProcessDecisions (System.Collections.Generic.List`1[T] decisions) [0x000d9] in <db6accd1acca4b7b89f971b6407b53be>:0 

19-2-26 21:07:05.0|Debug|Api|[POST] /api/release/push: 200.OK (5674 ms)
19-2-26 21:07:05.0|Info|DownloadService|Report sent to qbittorrent. The Gifted S02E16 720p WEB x264-TBS
19-2-26 21:07:05.0|Info|DownloadService|Report sent to qbittorrent. The.Gifted.S02E16.720p.WEB.x264-TBS
19-2-26 21:07:05.0|Warn|ProcessDownloadDecisions|Couldn't add report to download queue. The.Gifted.S02E16.720p.WEB.x264-TBS

[v2.0.0.5301] System.UriFormatException: Invalid URI: The format of the URI could not be determined.
  at System.Uri.CreateThis (System.String uri, System.Boolean dontEscape, System.UriKind uriKind) [0x0007b] in <b3922b7d60404fa9ae645f1fb97f5b6b>:0 
  at System.Uri..ctor (System.String uriString) [0x00014] in <b3922b7d60404fa9ae645f1fb97f5b6b>:0 
  at NzbDrone.Common.Http.HttpUri.op_Explicit (NzbDrone.Common.Http.HttpUri url) [0x00006] in <da318c059b2c4e18a12ce1003b1dc734>:0 
  at NzbDrone.Common.Http.HttpClient.InitializeRequestCookies (NzbDrone.Common.Http.HttpRequest request) [0x00058] in <da318c059b2c4e18a12ce1003b1dc734>:0 
  at NzbDrone.Common.Http.HttpClient.Execute (NzbDrone.Common.Http.HttpRequest request) [0x00000] in <da318c059b2c4e18a12ce1003b1dc734>:0 
  at NzbDrone.Common.Http.HttpClient.Get (NzbDrone.Common.Http.HttpRequest request) [0x00007] in <da318c059b2c4e18a12ce1003b1dc734>:0 
  at NzbDrone.Core.Download.TorrentClientBase`1[TSettings].DownloadFromWebUrl (NzbDrone.Core.Parser.Model.RemoteEpisode remoteEpisode, System.String torrentUrl) [0x00024] in <db6accd1acca4b7b89f971b6407b53be>:0 
  at NzbDrone.Core.Download.TorrentClientBase`1[TSettings].DownloadFromWebUrl (NzbDrone.Core.Parser.Model.RemoteEpisode remoteEpisode, System.String torrentUrl) [0x000a4] in <db6accd1acca4b7b89f971b6407b53be>:0 
  at NzbDrone.Core.Download.TorrentClientBase`1[TSettings].Download (NzbDrone.Core.Parser.Model.RemoteEpisode remoteEpisode) [0x00148] in <db6accd1acca4b7b89f971b6407b53be>:0 
  at NzbDrone.Core.Download.DownloadService.DownloadReport (NzbDrone.Core.Parser.Model.RemoteEpisode remoteEpisode) [0x00191] in <db6accd1acca4b7b89f971b6407b53be>:0 
  at NzbDrone.Core.Download.ProcessDownloadDecisions.ProcessDecisions (System.Collections.Generic.List`1[T] decisions) [0x000d9] in <db6accd1acca4b7b89f971b6407b53be>:0 

19-2-26 21:07:05.0|Debug|Api|[POST] /api/release/push: 200.OK (5681 ms)
19-2-26 21:07:05.1|Debug|Api|[POST] /api/release/push: 200.OK (5755 ms)
19-2-26 21:07:05.2|Debug|Api|[POST] /api/release/push: 200.OK (5836 ms)

markus101 · February 28, 2019, 2:03am

Ahh concurrently pushed, that endpoint does not deal with concurrency at all, each request is validated on it’s own at the moment it’s pushed.

I’ve filed a GHI for it, in the mean time it’ll be an issue for your setup though.

muddro · February 28, 2019, 2:49am

Thanks for looking into it. Much appreciated.

rhom · February 28, 2019, 12:26pm

just want to check that any changes to concurrency checking (if made) wont impact concurrent manual downloads.

ie for some older shows that i’ve only just found i will manually search and then click on a lot of the releases to download them to try and find one that will actually download (a lot are exact duplicates from across sites). if manual downloads uses the same ReleasePushModule process then it could impact on that functionality.

im also presuming that these torrents arent exactly the same, ie the content may be the same just repackaged by multiple people but the hashes dont match, because if they did then both the download clients and sonarr already handle that situation

to be honest i dont think sonarr should be checking for concurrent requests. if i tell it to download lots of versions of the same show at the same time (via any available process/api) then so long as each request meets the requirements in sonarr then it should process the request.

realistically if im using an external search program and i only want one result being sent to sonarr then i would expect i would have to set that up in the search program itself, not within sonarr

either way it might be beneficial to check if the search program being used will accept that as a feature request on their end.

actually - a quick google shows that irssi autodl can be configured in multiple ways to only grab an episode once, or once within a time period, perhaps you could look into that?

muddro · February 28, 2019, 12:59pm

this is not something I can fix on irssis end:
https://github.com/autodl-community/autodl-irssi/issues/106. Just found that. As sonarr is the next step in the process, hopefully something can be done that accommodates both use cases.

markus101 · February 28, 2019, 6:49pm

This has nothing to do with Interactive search, by the time you see the results Sonarr has already processed them and decided which ones are rejected, approved and what order they are presented in.

This is entirely an issue with the /release/push endpoint which is used by external applications only and asks Sonarr to validate a release and if valid grab it. This endpoint in theory could conflict with an RSS Sync as well, if RSS Sync makes it’s decision, but hasn’t downloaded anything yet, the pushed release could be accepted and grabbed at almost the same time as the RSS Sync, in practice the push endpoint likely gets these releases minutes before RSS does so it’s unlikely.

system · April 29, 2019, 6:49pm

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.