I've met Roy Hattersley and been within earshot of Jasper Carrot - both really unpleasant at the time (but they might each have been having a bad day).
Midge Ure, Kevin Keegan & David Seaman are all really decent people, though (but they might each have been having a really good day
)
(Not very infamous, I know)