I always interpret it to mean "if you're going to hate anybody, hate me". It's deflecting blame away from his staff. "Full responsibility" is a bad term for sure.