What would you do if you were me?

I say move on. Act like you don't care and DO NOT HAVE WITH HIM AGAIN! He doesn't appear to respect you, at least not in front of his friends. That should be enough information for you to stop the fwb relationship. I don't think they work anyway, but if they did, it has to be with someone who respects you! Don't worry about what they think of you anymore, even if you did yell at them.