Initial page load: images in public folder vs CDN

For initial page download, is it true that images in the public folder are all downloaded whether they are needed on the current page or not?

Whereas if they’re hosted on a CDN (or somewhere remotely), they’ll only be downloaded when the user is on a page that uses that specific image URL?

Is this correct?