I can't see the ants will do any harm, except to you. I'd just continue adding good stuff to the pile, but turn it over and over and allow moisture........maybe not soaking because I wouldn't want to mat down the pile, but any wettness will aggrevate them. If you flip them over everyday for a while, they will get tired of dealing with you.