No, this checkmark has been added exactly for this purpose to overrule CSL because CSL does not handle this case well.
If you have un-checked “Always show DOIs and URLs” and have a journal that has “page” set you should not see a doi or URL in your citations. In that case we don’t give CSL the URL or DOI so it can’t display it.
If it is not what you see it might be something else or indeed a bug.