Well, then I have some 'social problems' as well, because I'd rather not interact with those that have already bitten me in the past.

New people, that I have not yet interacted with have the benefit of the doubt, but the bullies from yesteryear did not magically grow into upstanding and respectable citizens.

I'm still in contact with some people from my highschool but they're definitely very much in the minority.

And when somebody gets bullied and you are 'doing nothing but not talk to him' you are also letting the bullying happening.

Neutrality is not always an option.