Torrents - Ready for Testing

Help & Support
#1

Torrent support has been merged into the develop branch

We’re at a point that we need some user input on the torrents branch. Due to potential stability issues this is not meant for end users.

Before diving into the torrents-branch please consider that it is recommended that you have past experience with the NzbDrone develop-branch and related subjects such as Debug/Trace log files.
Additionally, please note that torrents only work effectively with Completed Download Handling enabled.

You can view what has been implemented here: https://trello.com/c/MBXeXBqt/140-torrent-support

##Reporting issues and suggestions##
We welcome you to comment or report issues. A product is only as good as the input from its users.

Note that once something is fixed I will delete the related posts in an effort to keep this thread clean. Atm I’ve kept a small changelog on this thread to attribute fixes to the affected users.
If you believe you’ve been ignored please contact us on IRC or send a private message.

If you have an issue try to find the related error in the log file, preferably at Debug level. Things such as stacktraces and release/file names help us understand and reproduce the issue.

Obviously you’re also welcome on IRC: http://webchat.freenode.net/?channels=#sonarr

##Known issues##

  • Kickass does not search for Daily/Anime series.
  • Completed Download Handling for Torrent Clients only work on localhost.
  • NzbDrone is atm unable to handle torrent downloads containing .rar files. (Use an unpack script in the downloader)
  • No good integration with nzbToMedia, need to collaborate with the nzbToMedia devs to get to something useful.

##Getting started##

You should take a backup before switching to the torrents-branch (https://github.com/NzbDrone/NzbDrone/wiki/Backup-and-Restore)

Once you go to the torrents-branch you should stay on it. If you delete the torrent Indexers & Download Clients from the NzbDrone configuration it is currently possible to revert back to develop-branch.

It doesn’t update? What should I do now? If the version of torrents is LOWER than your current version then NzbDrone will refuse to automatically update. You should wait until a new version for torrents is published, otherwise you might run into database migration conflicts. (You can try download the installer manually, but that will only work if the database is compatible)

###Windows###

Switch your branch to “torrentsdevelop” (no quotes): https://github.com/NzbDrone/NzbDrone/wiki/Release-Branches

After changing branches, compare the version you have installed with System->Updates. We get a lot of question by people whom only switched branches and didn’t actually install the torrent version, usually in the form “Where can I add torrent indexers/download clients, I can’t find it.”. Read the “It doesn’t update” section earlier.

###Linux/OS X###

Either switch the release branch (same steps as Windows) and update via drone’s UI.

Grab the appropriate tar.gz from: https://download.sonarr.tv/v2/develop/latest/

1 Like
#24

Version 2.0.0.1810

  • Transmission Authenticated SessionID fixed. (@NMe)
  • Rssfeed deserialization fixed. (@TRaSH)
  • Deluge save folder fixed. (@EvilMonkeySi)
  • Updated Nyaa Rss Feed filter spec. (xelra)
  • Better error logging during test.

I’ve removed all posts related to those fixes. If you still have problems, lemme know. New issues are of course also welcome.

#34

Version 2.0.0.1814

  • Regression in Transmission session id (409 Conflict) (@NMe)

Sry about that.

#46

Version 2.0.0.1816

  • Fixed: Failed download handling no longer gives an exception for Deluge. (@Clayboy)
  • Fixed: CopyUsingHardlinks config option now correctly stored. (@sammy2142)
  • New: Added additional SxxExx search query format for Kickass. (@sammy2142)
  • Now logging the Api call Uri to debug for diagnostic purposes. (@NMe, @Clayboy)
#87

Version 2.0.0.1819

  • Fixed: Changed Basic Auth logic for Transmission to fix a (probably) syno-specific issue. (@NMe)
  • Fixed: IPTorrents RSS size parsing
  • New: Release sorting based on type (usenet vs torrent) and seeders. (@sammy2142)
  • Now checking if a indexer returns html instead of the rss feed to detect blocked or otherwise unavailable sites. (@lemonflavoured)

Some of the issues mentioned in this thread aren’t solved yet, we wrote some code already for those, but it isn’t good enough yet.

1 Like
#106

Version 2.0.0.1873 (rebased on develop 2.0.0.1872)

  • Fixed: Deluge proxy will now tell the web api to connect to the first available daemon. (@Clayboy)
  • New: Added SSL option to Deluge Settings, but it might not work on all platforms depending on enabled ciphers in your OS.
  • Fixed: Now shows UI notification if downloading torrent file from indexer fails. (@clone1612)
  • Fixed: Limited Deluge Label to lowercase a-z and - since whitespace and capitals are not allowed.
  • New: Added Url Base and SSL to Transmission to make it easier to connect to seedboxes. Also added error if the remote site does a redirect. (@bob)

Sorry folks for the delay, develop was a bit unstable for a few days so couldn’t rebase.

For those who were waiting for a new version so nzbDrone would autoupdate, here is it.

@bob, tnx to xelra we discovered the site was actually doing a permanent redirect from /transmission/rpc to /[username]/transmission/web (web instead of rpc, so drone could access the correct endpoint).

1 Like
#114

I moved 7 posts to a new topic: Support for generic torrent indexer api

#117

I moved 6 posts to a new topic: Not seeing download process for Transmission

#133

I moved 2 posts to a new topic: Drone gives error when trying to upgrade hardlinked file

#145

I moved 6 posts to a new topic: Delay Torrent grabs so usenet gets fetched first

#157

Version 2.0.0.1995

  • New: Transmission ‘category’ support.
    Version 2.0.0.1994 (rebased on develop 2.0.0.1988)
  • New: Added Priority settings to Deluge, Transmission and uTorrent. (@GlitchZA)
  • Fixed: Blackhole clients should now properly import via CDH. (@protocol77)
  • Fixed: uTorrent now properly handles when files are stored directly in the drive root. (@tamara_)
  • Fixed: Indexers redirecting torrent links to a magnet are now handled properly. (IRC)
  • Fixed: If Nyaa reports 0 seeds & 0 peers we assume it was unable to update stats. (IRC)

Been a while, sry about that but I wanted a few things integrated for this release.

I’ve been working on refactoring the indexer code to support BTN, but that isn’t ready yet.

What I did was refactor the Local Category Path code to use a Remote Path Mapping table (see Settings -> Download Clients -> Remote Path Mapping).
This feature was actually released on the dev-branch, as it contains a database migration.
This allows you to use torrent clients on remote systems and use that table to have drone map between paths. Allowing you to use Completed Download Handling.

Other highlight is ‘category’ support for transmission. Since transmission doesn’t support categories natively we had to cheat. If you specify a category, drone will ask transmission to append ‘.{category}’ to the download path.
This allows drone to recognize it and filter the list of torrents early, which helps performance and prevents those other torrents from showing up in History -> Queue.

Please note that if you use pp-scripts in transmission that move it, be sure to include that subdirectory or drone will ignore the torrent on the api.

Update: Something went wrong with the rebase/cherrypick process for 1994 and I forgot the transmission category commit. Fixed that in 1995.

#160

I moved 2 posts to an existing topic: Stalled torrent detection

#167

I moved 2 posts to an existing topic: Delay Torrent grabs so usenet gets fetched first

#173

I moved 4 posts to a new topic: Stalled torrent detection

#180

I moved a post to a new topic: Bittorrent sync support

#181

Version 2.0.0.2021 (rebased on dev 2.0.0.2020)

  • Rebased on dev simply because it contained an important fix I wanted on the torrent branch.
  • Fixed: History->Queue no longer shows -1 for unknown uTorrent eta.
#196

Version 2.0.0.2054 (rebased on develop 2.0.0.2051)

  • Updated torrent indexers to new indexer architecture (which is partially included in develop for the usenet indexers)
  • Fixed: Kickass api responding with 404 is now considered as ‘no results’ instead of an error. (@lemonflavoured, @sammy2142, @tamara_ )
  • Fixed: ETA issue in uTorrent showing -1 when unknown.
  • Fixed: No longer showing UI queue error if unable to communicate with Download Client.
  • New: Added support for BroadcastheNet private provider for normal and daily series. (@Clayboy)
  • Fixed: kat now also searches for Sxx for the season search query instead of only season:x. (@M0UL)
  • Fixed: CDH with Deluge now works remotely from Windows to Linux.
  • Fixed: Timeout issues with Deluge should be solved now. (@saitoh183, and others)
  • Fixed: For Deluge, drone will now detect if stop_at_ratio is enabled and whether that share ratio has been met allowing drone to remove it after seeding has finished. (@M0UL, @tamara_)

These updates have been a long time coming. With special thanks to Clayboy.

After finishing the indexer stuff I managed to spend some time with Deluge, let me know if you have remaining timeout issues.

Since we essentially redid the indexer implementations we may have inadvertently broken some searches. So please let me know if something odd happens.
One note though, especially for BTN but also other private trackers. They often remove episode torrents after a season torrent has been posted. Episode searches in drone will not show season results. Please keep this in mind if it appears that drone is not returning results.
(Afaik there is a trello card for manual season searches)

This is rather intentional, you don’t want drone to automatically download a season pack if you miss 1 episode. Do that manually in your torrent client so you can attempt to seed the other episodes.

2 Likes
#226

Hi @Taloth
I’ve just been messing around with feeds on torrentz.eu and thought I would provide some feedback if its useful (if you decide to add this provider)?

Torrents are tagged with appropriate categories. A search for tv returns all torrents tagged with the tv category:
http://torrentz.eu/feed_verifiedA?f=tv (for verified torrenets only)
http://torrentz.eu/feedA?f=tv (for verified torrents and all torrents with a score of 0 or above)

All torrents with a negative score are not returned in the feeds.

The results returned in the rss feeds provide information on size, number of seeders/peers and the infohash.
No magnet links or direct links to a .torrent file are provided - but a magnet link can easily be generated by using the infohash (magnet:?xt=urn:btih:infohash).

The search seems pretty smart.
A search for arrow s01e05 also returns results for 1x05 etc:
https://torrentz.eu/feed_verifiedP?f=arrow+s01e05

The feed can be sorted a number of different ways:
Peers/seeders (highest to lowest)
http://torrentz.eu/feedP?f=
http://torrentz.eu/feed_verifiedP?f=

Age (newest to oldest)
http://torrentz.eu/feedA?f=
http://torrentz.eu/feed_verifiedA?f=

Size (largest to smallest)
http://torrentz.eu/feedS?f=
http://torrentz.eu/feed_verifiedS?f=

Rating (highest to lowest)
http://torrentz.eu/feedN?f=
http://torrentz.eu/feed_verifiedN?f=

There are a number of advanced search options including size parameters and seed parameters etc which can be found on the help page:
https://torrentz.eu/help

It is a metasearch site that searches 33 different free torrent sites (including the piratebay) and seems pretty great :stuck_out_tongue:

[Resolved] Torrentz integration
#227

Been using this now for a while and its great, though one possible idea I would like to suggest for improvement on the manual search page when it lists torrents its found on indexers it would be great if it listed the number of seeds on the torrents found if that’s at all possible.

3 Likes
#228

I would like to point out a small problem for some of my series.
Kickass is only able to find torrents by verified users. This causes problems with stuff that isn’t that popular, like foreign series.
You’d expect a button to turn that off (for certain series) :smile:

Obviously an upload from a verified user normally would be the first choice, but when there are only uploads from unverified users for a show it’s not possible to catch the uploads.

Thanks for taking this in consideration! Loving the software for my other stuff though!!