It's better than some of the professors at my college where they had late night office hours. It was a lesson learned for both of you. He should have realized what was happening and put a stop to it.