› A confidence score of 0.9 sounds like a promise: the model should be right nine times out of ten.
› But the number alone proves nothing.
› You need to compare it with correct answers on data like the cases your application will handle.
› Below, I explain calibration, show calculations from saved results for three models, and share a simple Python script.