They are disgusting. However, some people really like them.

Here's a brief run down:

http://www.wisegeek.com/what-are-pickled-eggs.htm