How Confident Are AI Classifiers About Their Own Confidence?

I'd love to see more of this sort of thing, as I think it's central to a lot of controversies in AI at the moment (not all but many).