What do you act like for a person like this?

You've already answered your own question...Everyone in your group seems to know what kind of guy he is...I would ignore him because reacting feeds him...And take it for granted that all know his number and don't give him the honor of your concerns.