We refer to a confident algorithm as one that has run enough tests in the learning phase to accumulate statistically significant confidence intervals regarding its hypothesis. However, just because a machine is confident does not mean the machine is accurate.

If you want a more precise confidence interval, use the online calculator available at www.measuringu.com/wald.htm.

Testing offers a respite from the decision-guessing pressure. Instead of guessing, you can test to find out what works better, and the information you get from testing is statistically significant.