I don't watch the show closely, but I've only seen him on it once. This may be a good thing from the programme maker's point of view because Tom was far funnier and more interesting than the panel members.
I must say, I wish Tom had his own panel show, something like QI, which allowed him to ad lib and tell the occasional anecdote. I think it would be superb.
"A man's work is nothing but this slow trek to rediscover, through the detours of art, those two or three great and simple images in whose presence his heart first opened."