The joke is that you'll say he's the kind you have a repugnance for, but you won't come out and say Hannibal Lecter is a horrible person, because if you did that you might have to say why, and then you might have to think about how you treated your son.

The joke is that you're almost nothing like him.