I agree we should communicate this better. Still there are many reasons including technical ones why we need those links. They are not optional.
Once you realize that the references are linked you are in control who you share it with so I think the “anyone with a link” model still applies.