It's funny - as I've gone along, some names that originally seemed outlandish are now nothing to think twice about!
These are both from my own family and interesting names I've come across while helping friends.
Female: Asenath, Averilla, Purlina, Iziphina, Dicy, Maris (probably named after her father's maternal grandmother, who's last name was Maris), Zita (went by "Zite"), Tennie, Wilmot, Paralee, Anthenia, Zuby, Ogareta, Posey, Zephonia, Ozena, Wonedith, Leatrice, Reka, Dulcenia, Gulielma, Modeska, Thursey, Ludenie, Ufame, America, Amazona, Eldora, Capitola, Electra, Leoma, Dortha, Delphina, Myrtilla, Sophronia, Sevela, Salome, Phedora, Juritta, Cyrena, Orpha, Nedra, Narcissa, Elzina, Marilda, Manzanilla (went by Manza), Lurainey, John Beatrice, Ione, Hixey, Guilda, Eureka, Erie, Cynthiana
Male: Drewry (I've seen it once or twice but it sure tripped up anyone writing down his name!), Van (just Van, nothing else), Eusebius, Flavius, Hiram, Ryce, Asahel, Zadoc, Ahimaaz, Elda, Albanus, Barzillai, Marcellus, Cassius Mountain Clay, Reason, Wiseman, Burdella, Drummond, Kinion, Ledru Rollo, Lovelace, Needham, Onoro, Zimri, Zeno, Pointeaux
I think the most amazing thing I've seen was from helping a friend out with her tree - we found that her 4th great grandparents had two daughters, Martha Amaranth and Capitola, and eight sons ALL with X names - Xerxes, Xenophen, Xanthus, Xylander, Ximenes, Xuthus, Xystus, and Xenia. Now THAT took some effort, especially for the 1860s-80s.