Episodes deleted from disk keep downloading

Oh ok, so the best way then is to just delete it from the UI, got it. Would that delete the file itself too?

Yes it will. It will handle everything you need in this case.