Just as you said. Insult and push them around and you should be able to humiliate them. If that doesn't work, just beat 'em up a bit and then humiliate them.
If they get scared of all the pushing and smack talk, the person will run off. Just follow them at a distance and they'll soon stop and start crying. If you get too close, they'll keep running away.