Apostrophes (and other things) in Display Name don't display right

(Bug, Closed -> Fixed, Priority: High, Test Status: No automated tests yet , Reported By Bad Link: Thing 3y284og not found, )
Summary: This bug (intentionally) shows the problem.

Justin: the issue is clearly that we are over-escaping HTML entities. I suspect that fixing it won't be trivial, since there may be multiple areas where the bug shows up. The header of the page is one -- are there others?
I'm kicking this one up to High priority, simply on the grounds that it is beginning to annoy the snot out of me in this Issue Space.
Talvin: I am adding this here rather than creating a separate Bug Report, as it is just an expansion of the issue: http://www.querki.net/u/Talvin/talvins-sandbox/Testing---Punctuation I started out trying what could/could not work in Names, found your Error Message (Yay!) and then went on to try Display Names. I wound up going through all the standard non-alphanumeric keyboard characters and noting which ones break.
Justin: Thanks! That's a nicely consistent list -- they're basically the common HTML entities, which confirms my suspicion of roughly what's going on. Now to go figure out why it's happening...
Justin: Okay, fixed in at least most places. This one is persnickety, though, so please tell me if you find any other cases of it. (I fixed it in a dozen or so places that I could find.)