Certificate handling is done outside of drone/sonarr, it is done within mono/the OS (on Windows its done through a component of Windows). When you switched the port did you run the external config tool again?
https://github.com/NzbDrone/NzbDrone/wiki/SSL#linux--os-x - make sure its run by the user that will be running mono.