I was worried that I missed out on capturing a fun bug, because I only spotted this while already clicking on the notification, and opening the iMessage thread fixes it.

Luckily it could be reproduced simply by restarting the Messages app.