That's normal behavior. Save as and save image as override that setting.
For it to work with an image, you'd have to left-click on a link to an image to navigate to it where the server sends the image with a Content-Disposition of attachment to tell the browser to download it instead of displaying it.