Yeah, I've seen people banned for less than this. If your adsense account means anything to you, do not use it on any site that allows adult content, even if that's not the primary focus of the site. You're better off to use Adbrite on that site, which does allow adult ads and even has a special department for them.