Ok, I understand your point, an HTTP 404 is recommended. For us a HTML 404 works fine because we prerended everything and basically … there is no server to return a HTTP 404 but the Prerender does that based on the HTML metas.
For SSR, I think this answers the question: Make server respond with 404 status on unmatched URLs - #4 by coagmano