The appendices to Bringhurt's Elements of Typographic Style are very useful for this, though I admit I don't remember if he lists Unicode values for all of them. And of course, this is only for Western alphabets. You could also try the Unicode site itself — for instance:
http://www.unicode.org/charts/PDF/U0300.pdf
Though the code tables don't identify languages that the diacritics are used in, Bringhurst does, so between the two resources you may have what you need.
Josh