I found this,
Alternator Clip "How-To", but it looks as if half of his post is missing now so I have no idea of what to even look for.
I don't have any of those other issues though and my voltage is perfectly fine. Alternator seems to be working just fine, no noises from the alternator itself and no problems with any lights whatsoever. Just the clicking sound they mention in that thread.