when does it qualify as harrassment

I have an issue with one of the junior managers within my branch.  Although he is not my direct line manager I have to report to him for technical decision making - i am effectively one of his deputies in the branch and therefore we should enjoy a close working relationship however he seems to want it closer than appropriate!

the 1st instance was 18 months ago where we were on a client meeting (jolly) where alcohol was freely flowing and his hands began to wander............ i slapped him away but wasnt in a position to tell him loudly to stop as was in front of several customers - another member of staff walked me back to the train station and by the time I got there I had several text messages and missed calls effectively aksing me "do you not want to see me" etc etc - however nothing lewd.  the next day he did apologise and was very sheepish.  all managment team have staff no in their phones for disaster recovery planning hence how he has my number.

this has re-occurred on several occassions and some colleagues have commented on it (unfortunately drink has always been involved) - Ive never raised it with anyone senior as I didnt believe it was a big issue or that it would be taken seriously by the management team.

Ive also noticed in the office that he generally doesnt look at my face when he talking to me, its normally my chest - Ive felt I have had to change my wardrobe to wear clothing that provides more coverage ie polonecks - nothing I own is that revealing anyway!

I had last week off as holiday and he has this week off as its half term and he needs to look after his 3 children (sorry i forgot to mention he is married with 3 small kids) and I was horrified to receive a text from him at 8pm on saturday (end of my holiday, beginning of his) "telling me he really really missed me whilst ive been of, he knows he shouldnt be texting me and to tell him if i want him to stop."

Given that he is senior surely he is abusing his position but now he has put the onus on me to stop it - there have been no subsequent texts but I am very uncomfortable about going to work on Monday when he returns to the office. I have talked it through confidentially with 2 close friends from wrk but neither agree on what to do - one believes I should keep quiet, the other thinks i should tell my (and his) line manager who is also the Branch manager.  Im not confident that the matter would be addressed correctly and that it would be brushed under the carpet or a hand slapping "dont be such a naughty boy" which I dont believe addresses the issue.  we dont have onsite HR to discuss this and I have no relationship with our HR advisor in branch.

I dont know what this falls under - it isnt crude overt sexual harrassment but it makes me feel uncomfortable and not able to necessarily do my job.  I am currently looking for another position ( i had an interview during my week off but didnt get the position) otherwise I would have resigned and mentioned it then

All I'm looking for is if anyone can offer any advice on how to tackle the situation and whether I should speak to someone or wait until I hopefully find another job and then tell my manager that this has caused part of the reason for me resigning.

thanks for any help

helen