Aw, but you shouldn't be angry at Amstell really, that's just his thing, he mocks all the guests at least a little and the fun is to see how they respond to it.
Plus, did you see the montage of Noel's moments he made the episode right after this one, when Bill Bailey comes back? I thought it was just too cute and funny <3