In addition to the octothorp, other obscure named symbols include the solidus (/), and the asterism, recently discussed in this forum.

Perhaps I should mix typefaces, but I thought that it would be great if I could get away with Goudy Oldstyle and Italic exclusively. They seem to have just about every anatomical feature going for them. Good call on the solidus. I'll add a fraction.

In searching for information about the bullet point, I learned something new: that the paragraph mark is called the 'pilcrow'. Also, a fleuron used as a paragraph divider is sometimes called a 'hedera' (at least when it is in the form of an ivy leaf, the meaning of that word).

For an example of hedera in a font http://typophile.com/node/117364
and a font with 148 other variations http://www.myfonts.com/fonts/lanston/ltc-vine-leaves/ltc-vine-leaves/
Don

Pilcrow http://www.typography.com/blog/pilcrow-capitulum
Don

And then there's the typographic manicule/fist...

BTW the most important thing about a good pilcrow goes unmentioned in that HTF article: that it must look heavier than the rest of the font, so that it can do its intended –or at least typical– job.

hhp

¶ Some lower cases have spurs: see "b, q".

¶ Spurs are found in some Old Style, Transitional, Scotch Roman and Slab Serif and Grotesque/Neo-Grotesque Sans.