Evan's Awesome A/B Tools (home):

Sample Size Calculator  |  Chi-Squared Test  |  Sequential Sampling  |  2 Sample T-Test  |  Survival Times  |  Count Data

Question: Does the average value differ across two groups?

[ link ]
Sample 1 Confidence intervals and estimated difference Sample 2





 Mean:
 Std. Dev.:
 Count:
Sample 1 mean0.293 ± 0.023
Sample 2 mean0.451 ± 0.031
Difference of meansd = 0.15    SE = 0.023   
p =





 Mean:
 Std. Dev.:
 Count:
Verdict:   No significant difference
Hypothesis:      
Confidence:
95%

If the experiment is repeated many times, the confidence level is the percent of the time each sample's mean will fall within the confidence interval.

It is also the percent of the time the hypothesis will be accepted (i.e., no difference detected), assuming the hypothesis is correct.
If you like this, check out Wizard — the easy Mac statistics app.