Just as kind of an aside, don't be too quick to think that way. Your "friend" hasn't learned anything that way if you don't at least tell him He may think that type of action is an OK joke, or worse, a way to further a relationship. Something as simple as firmly telling him, alone, or better yet, with a trusted friend, male or female. If he learns something positive for his relationships, good for him. Regardless, it might begin to give you a little more feeling of being in charge of your life. As Jenna pointed out, that is important as well.
Has this person said anything since then, or made any other attempts at verbal or physical interaction?