I tried the olive oil idea, and it did help I think. Today it's not so bad, except when I have my hands in hot water; then it starts to sting a bit again. I'll remember the milk next time (although I hope there won't BE a next time)
I always used milk for after eating jalapenos in food. I read that the fat in the milk, neutralizes the oils in the peppers. Also, works with the sour cream on hot foods. I would think, dipping in whole milk, would maybe help? Worth a try anyways.