Performance Issues - How May I Improve?

Hey Guys -

So I’ve been running NZBDrone (Sonarr) for about 6 months now after replacing SickBeard. I like it much better and can’t say enough good things about it - Thanks for all the hard work!

I’m having performance issues with my installation and need some suggestions for how to improve it, please. I just looked through the console and saw that my RSS sync is running late as it’s taking longer than 15 minutes.

I opened the log file folder and found that between 4:09pm today and 5:15pm (just over an hour,) I’ve had all 50 log files rollover over! When examining them, I did find that logging was still set to Debug so set it back to Info. Still, though - with Debug on is 50 files in an hour normal? When opening them, it seems that NZBDrone is parsing each of the shows I have. Here’s an except:

14-10-27 16:36:42.5|Debug|Parser|Release Group parsed: 
14-10-27 16:36:42.5|Debug|Parser|Parsing string 'The Simpsons - S05E22 - Secrets of a Successful Marriage.info'
14-10-27 16:36:42.5|Debug|Parser|Episode Parsed. thesimpsons - S05E22 
14-10-27 16:36:42.5|Debug|Parser|Language parsed: English
14-10-27 16:36:42.5|Debug|NzbDrone.Core.Parser.QualityParser|Trying to parse quality for The Simpsons - S05E22 - Secrets of a Successful Marriage.info
14-10-27 16:36:42.5|Debug|Parser|Quality parsed: Unknown v1
14-10-27 16:36:42.5|Debug|Parser|Release Group parsed: 
14-10-27 16:36:42.5|Debug|Parser|Parsing string 'The Simpsons - S05E22 - Secrets of a Successful Marriage.info'
14-10-27 16:36:42.5|Debug|Parser|Episode Parsed. thesimpsons - S05E22 
14-10-27 16:36:42.5|Debug|Parser|Language parsed: English  

Basically, NZBDrone is running really slow even after restarting everything. Below is my setup info:

System Environment

  • Intel i7 3770k /16gb RAM / Installed onto SSD with plenty of room
  • All media is stored on 24.4tb DrivePool (x8 hard drives + a 55gbSSD Landing Zone) - (Separate SSD than OS SSD)
  • Windows 8.1 Update 1 Fully Patched / Console run via Google Chrome
  • Running build (2.0.0.2064) / Installed as a Windows Service
  • Uses purchased SSL certificate for HTTPS Access
  • Uses SABnzbd for downloader
  • 382 Series Total
  • 166 Ended / 216 Continuing
  • 143 Monitored / 239 Not Monitored
  • 29096 Episodes / 10657 Files
  • Quality Profiles - There are really only two I use:
    • “Any - 720p Cutoff” (Looks for any release and stops at 720p)
    • “720p Only” (Looks for any 720p release only)
      Most shows that aired prior to the HD era are set to the Any profile and others are set to 720p.

If for whatever reason my database has gotten to a point where this performance is expected (not due to bug or configuration issue,) then is there any upgrade I can do to increase performance? Is it possible to migrate to SQL to improve speed perhaps? I’ve read that running on Linux improves performance. If so, by how much?

Any suggestions would be appreciated - Thanks!

No, my debug logs go back to the 24th at 10pm - just shy of 72 hours.

sonarr (drone) will rescan your series folders every 12 hours for changes (deletions/additions/etc), this is normal and expected, on my system (197 shows) this takes about 15 minutes, I’d expect your system to take about 2x as long due to the number of shows.

Is ‘The Simpsons - S05E22 - Secrets of a Successful Marriage.info’ a file already sorted in a series folder?

I don’t think this is a performance issue with the database, while you have a large collection there are larger ones without this issue.

No, only sqlite is supported (its not trivial so support multiple database engines).

That seems to be a general feeling with other services, but with sonarr I suspect its the opposite, not to say it runs poorly on Linux, it just doesn’t run quite as well our testing on Ubuntu shows it being a bit slower, but nothing to be concerned with.

I have a few questions to better understand your configuration:

Do you have more than one TV root folder? (add series → add existing) What is/are the path(s) for that?
Do you Completed Download Handling (CDH) enabled?
Do you have the Drone Factory configured? If so whats the path?
During this hour was the UI showing a Updating/scanning message for each series?
Could you zip up the logs and PM me a link to download them? I’d like to see whats its doing.
What version of sonarr (drone) are you currently running?

Might have some more questions later, but thats a good start.

Thanks for the reply. I appreciate your input. Here are the answers to your questions:

Do you have more than one TV root folder? (add series -> add existing) What is/are the path(s) for that?

  • No, just one path (D:\Media\TV Shows) - However, it is on a Drive Pool so even though in one folder the shows are physically on 9 disks. Same performance, though overall.

Do you Completed Download Handling (CDH) enabled?

  • Yes

Do you have the Drone Factory configured? If so whats the path?

  • Yes, but it’s not really used (Assuming it’s different than post download. It’s path is “D:- App Cache -\Drone Factory” where the SABnzbd category path is “D:- App Cache -\TV Cache”

During this hour was the UI showing a Updating/scanning message for each series?

  • I wasn’t in the console but for about fifteen minutes. During this time, I saw an RSS sync in the bottom right which took a long time and was one of the reasons I started looking into things. During this time I also added a couple more shows, but the logs and all went on well before I did that. That’s all I saw if that answers you question

Could you zip up the logs and PM me a link to download them? I’d like to see whats its doing.

  • Wow - Thanks - will do! Obviously ogs have dropped off since my post since I changed from Debug to Info. Used best compression I could and got it down to around 1mb. I’ll send you a PM right after this - Thanks!

What version of sonarr (drone) are you currently running?

  • (2.0.0.2064)

Please let me know if you need anything else. Sending a PM in a few. Thanks again for your help!

The log files got clobbered because of the series refresh that takes place every 12 hours. The refresh finished up at 4:44pm, but not sure when they started as it was into the G’s in the old log file (4:09pm).

Thats the reason the RSS Sync was delayed, because it was blocked by this other job. I wonder if the refresh takes as long as it did with the logging turned down to Info instead of Debug. Looking at a couple series it was taking 15 seconds to refresh one series, but in other cases only a few seconds. Could be a number of reasons why it slows down, but nothing jumps out. If you can zip up your info logs when you get a chance I’d like to see how long to total refresh process takes, and should have enough details in info logs.