White Vinegar is my favorite. That and a good scrubbing with hot water. I try to avoid bleach.
Because I have ducks, I'm a bit paranoid about keeping the waterers clean -- when the weather gets hot I don't want any toxic alge!
And there is no such thing as a stupid question, btw. ;)