Effect Size — Small (≈ d=0.2)

Sample Size — n = 5

Game 1

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.713
2	0.317
3	0.508
4	0.530
5	0.715
6	0.571
7	0.357
8	0.577
9	0.298
10	0.084

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Hypothesis Testing Decision Matrix (for this pretend scenario): If you picked “None of the Samples”, that was the correct decision. Otherwise, you made a “Type I Error” by rejecting the null hypothesis when in fact it was true.

Game 2

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.894
2	0.635
3	0.089
4	0.108
5	0.721
6	0.773
7	0.210
8	0.611
9	0.618
10	0.246

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 3

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.383
2	0.595
3	1.000
4	0.426
5	0.651
6	0.743
7	0.142
8	0.139
9	0.719
10	0.947

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 4

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.717
2	0.868
3	0.697
4	0.300
5	0.457
6	0.936
7	0.781
8	0.582
9	0.052
10	0.454

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 5

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.299
2	0.305
3	0.145
4	0.807
5	0.217
6	0.491
7	0.256
8	0.282
9	0.256
10	0.786

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #6

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #6, p = 0.491 (> .05).

Hypothesis Testing Decision Matrix (for this pretend scenario): If you picked Sample #6, that was the correct decision. Otherwise, you made a “Type II Error” by failing to reject the null when it was false (for Sample #6).

Game 6

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.516
2	0.389
3	0.742
4	0.414
5	0.902
6	0.877
7	0.472
8	0.883
9	0.034
10	0.314

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Not supported by p-values — at least one sample had p ≤ .05 (e.g., Sample #9: 0.034).

Game 7

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.747
2	0.054
3	0.193
4	0.012
5	0.603
6	0.690
7	0.281
8	0.946
9	0.491
10	0.274

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Not supported by p-values — at least one sample had p ≤ .05 (e.g., Sample #4: 0.012).

Game 8

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.681
2	0.779
3	0.591
4	0.484
5	0.861
6	0.262
7	0.507
8	0.058
9	0.150
10	0.434

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 9

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.788
2	0.500
3	0.298
4	0.709
5	0.599
6	0.640
7	0.457
8	0.785
9	0.511
10	0.341

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #5

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #5, p = 0.599 (> .05).

Hypothesis Testing Decision Matrix (for this pretend scenario): If you picked Sample #5, that was the correct decision. Otherwise, you made a “Type II Error” by failing to reject the null when it was false (for Sample #5).

Game 10

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.864
2	0.836
3	0.749
4	0.313
5	0.959
6	0.464
7	0.918
8	0.499
9	0.520
10	0.557

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #10

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #10, p = 0.557 (> .05).

Hypothesis Testing Decision Matrix (for this pretend scenario): If you picked Sample #10, that was the correct decision. Otherwise, you made a “Type II Error” by failing to reject the null when it was false (for Sample #10).

Sample Size — n = 25

Game 1

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.657
2	0.364
3	0.644
4	0.878
5	0.335
6	0.229
7	0.871
8	0.156
9	0.729
10	0.332

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 2

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.235
2	0.857
3	0.272
4	0.042
5	0.241
6	0.699
7	0.636
8	0.670
9	0.442
10	0.164

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Not supported by p-values — at least one sample had p ≤ .05 (e.g., Sample #4: 0.042).

Game 3

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.127
2	0.177
3	0.351
4	0.243
5	0.685
6	0.165
7	0.861
8	0.720
9	0.137
10	0.008

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Not supported by p-values — at least one sample had p ≤ .05 (e.g., Sample #10: 0.008).

Game 4

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.043
2	0.740
3	0.973
4	0.728
5	0.156
6	0.022
7	0.415
8	0.841
9	1.000
10	0.787

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #10

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #10, p = 0.787 (> .05).

Game 5

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.619
2	0.085
3	0.436
4	0.648
5	0.602
6	0.389
7	0.057
8	0.073
9	0.339
10	0.434

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #2

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #2, p = 0.085 (> .05).

Hypothesis Testing Decision Matrix (for this pretend scenario): If you picked Sample #2, that was the correct decision. Otherwise, you made a “Type II Error” by failing to reject the null when it was false (for Sample #2).

Game 6

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.409
2	0.473
3	0.088
4	0.749
5	0.533
6	1.000
7	0.043
8	0.226
9	0.535
10	0.482

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #5

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #5, p = 0.533 (> .05).

Game 7

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.280
2	0.926
3	0.388
4	0.797
5	0.517
6	0.696
7	0.515
8	0.922
9	0.718
10	0.818

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #5

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #5, p = 0.517 (> .05).

Game 8

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.610
2	0.329
3	0.892
4	< 0.001
5	0.057
6	0.132
7	0.186
8	0.148
9	0.734
10	0.293

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #2

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #2, p = 0.329 (> .05).

Game 9

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.331
2	0.707
3	0.804
4	0.949
5	0.972
6	0.146
7	0.817
8	0.232
9	0.978
10	0.450

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #8

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #8, p = 0.232 (> .05).

Hypothesis Testing Decision Matrix (for this pretend scenario): If you picked Sample #8, that was the correct decision. Otherwise, you made a “Type II Error” by failing to reject the null when it was false (for Sample #8).

Game 10

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.947
2	0.125
3	0.760
4	0.404
5	0.523
6	0.330
7	0.653
8	0.111
9	0.208
10	0.155

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Sample Size — n = 100

Game 1

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.909
2	0.543
3	0.214
4	0.060
5	0.901
6	0.419
7	0.857
8	0.542
9	0.209
10	0.006

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #9

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #9, p = 0.209 (> .05).

Hypothesis Testing Decision Matrix (for this pretend scenario): If you picked Sample #9, that was the correct decision. Otherwise, you made a “Type II Error” by failing to reject the null when it was false (for Sample #9).

Game 2

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.672
2	0.578
3	0.879
4	0.319
5	0.923
6	0.770
7	0.141
8	0.703
9	0.164
10	1.000

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #2

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #2, p = 0.578 (> .05).

Game 3

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.986
2	0.498
3	0.076
4	1.000
5	0.869
6	0.544
7	0.046
8	0.619
9	0.135
10	0.115

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Not supported by p-values — at least one sample had p ≤ .05 (e.g., Sample #7: 0.046).

Game 4

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.819
2	0.057
3	0.164
4	0.537
5	0.972
6	0.729
7	0.657
8	0.764
9	0.659
10	0.833

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #2

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #2, p = 0.057 (> .05).

Game 5

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.925
2	0.692
3	0.073
4	0.280
5	0.151
6	0.223
7	0.006
8	0.060
9	0.437
10	0.158

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #5

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #5, p = 0.151 (> .05).

Game 6

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.632
2	0.011
3	0.921
4	0.400
5	0.176
6	0.265
7	0.179
8	0.115
9	0.647
10	0.088

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #2

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #2 (0.011).

Game 7

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.774
2	0.387
3	0.468
4	1.000
5	0.594
6	0.134
7	0.353
8	0.279
9	0.170
10	0.306

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #6

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #6, p = 0.134 (> .05).

Game 8

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.507
2	0.676
3	0.584
4	0.915
5	0.739
6	0.879
7	0.594
8	0.802
9	0.354
10	0.704

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #1

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #1, p = 0.507 (> .05).

Hypothesis Testing Decision Matrix (for this pretend scenario): If you picked Sample #1, that was the correct decision. Otherwise, you made a “Type II Error” by failing to reject the null when it was false (for Sample #1).

Game 9

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.512
2	0.666
3	0.200
4	0.010
5	0.262
6	0.924
7	0.505
8	0.613
9	0.520
10	0.612

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Not supported by p-values — at least one sample had p ≤ .05 (e.g., Sample #4: 0.010).

Game 10

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.235
2	0.137
3	0.252
4	0.228
5	0.116
6	0.875
7	0.692
8	0.434
9	0.632
10	0.713

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Sample Size — n = 1000

Game 1

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.006
2	0.521
3	0.295
4	0.356
5	0.244
6	0.966
7	0.388
8	0.292
9	0.505
10	0.382

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Not supported by p-values — at least one sample had p ≤ .05 (e.g., Sample #1: 0.006).

Game 2

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.575
2	0.408
3	0.919
4	0.013
5	0.710
6	0.528
7	0.741
8	0.739
9	0.873
10	0.260

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Not supported by p-values — at least one sample had p ≤ .05 (e.g., Sample #4: 0.013).

Game 3

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.044
2	0.386
3	0.319
4	0.618
5	0.837
6	0.996
7	< 0.001
8	0.879
9	0.340
10	0.632

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #7

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #7 (< 0.001).

Hypothesis Testing Decision Matrix (for this pretend scenario): If you picked Sample #7, that was the correct decision. Otherwise, you made a “Type II Error” by failing to reject the null when it was false (for Sample #7).

Game 4

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.894
2	0.573
3	0.572
4	0.649
5	0.337
6	< 0.001
7	0.655
8	0.231
9	0.212
10	0.970

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #6

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #6 (< 0.001).

Game 5

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.630
2	0.656
3	0.938
4	0.150
5	0.456
6	0.558
7	0.160
8	0.658
9	0.827
10	0.657

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 6

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.153
2	0.442
3	< 0.001
4	0.637
5	0.813
6	0.448
7	0.434
8	0.754
9	0.655
10	0.031

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #3

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #3 (< 0.001).

Hypothesis Testing Decision Matrix (for this pretend scenario): If you picked Sample #3, that was the correct decision. Otherwise, you made a “Type II Error” by failing to reject the null when it was false (for Sample #3).

Game 7

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.586
2	0.623
3	0.945
4	0.242
5	0.680
6	0.616
7	0.066
8	0.187
9	0.302
10	0.782

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 8

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.237
2	0.914
3	0.734
4	0.624
5	0.457
6	0.869
7	0.729
8	0.576
9	0.486
10	0.550

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 9

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.462
2	0.759
3	0.566
4	0.234
5	0.230
6	0.373
7	0.314
8	0.833
9	0.695
10	0.772

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 10

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.304
2	0.617
3	0.063
4	0.278
5	0.627
6	0.593
7	0.632
8	0.545
9	0.611
10	0.098

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Effect Size — Medium (≈ d=0.5)

Sample Size — n = 5

Game 1

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.737
2	0.290
3	0.169
4	0.160
5	1.000
6	0.041
7	0.807
8	0.880
9	0.584
10	0.099

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Not supported by p-values — at least one sample had p ≤ .05 (e.g., Sample #6: 0.041).

Game 2

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.697
2	0.077
3	0.644
4	0.701
5	0.890
6	0.916
7	0.669
8	0.025
9	0.624
10	0.109

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #5

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #5, p = 0.890 (> .05).

Game 3

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.539
2	0.850
3	0.217
4	0.151
5	1.000
6	0.861
7	0.041
8	0.015
9	0.274
10	0.190

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #8

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #8 (0.015).

Game 4

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.417
2	0.569
3	0.582
4	0.746
5	0.175
6	0.283
7	0.769
8	0.249
9	0.324
10	0.891

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 5

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.626
2	0.794
3	0.733
4	0.591
5	0.043
6	0.690
7	0.247
8	0.819
9	0.237
10	0.420

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #2

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #2, p = 0.794 (> .05).

Game 6

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.353
2	0.174
3	0.160
4	0.091
5	1.000
6	0.478
7	0.121
8	0.140
9	0.089
10	0.775

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #5

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #5, p = 1.000 (> .05).

Game 7

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.250
2	0.477
3	0.761
4	0.942
5	0.591
6	0.500
7	0.206
8	0.035
9	0.014
10	0.491

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #7

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #7, p = 0.206 (> .05).

Game 8

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.550
2	0.431
3	0.108
4	0.093
5	0.914
6	0.402
7	0.964
8	0.175
9	0.865
10	0.256

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #4

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #4, p = 0.093 (> .05).

Hypothesis Testing Decision Matrix (for this pretend scenario): If you picked Sample #4, that was the correct decision. Otherwise, you made a “Type II Error” by failing to reject the null when it was false (for Sample #4).

Game 9

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.086
2	0.315
3	0.806
4	0.523
5	0.491
6	0.612
7	0.125
8	0.351
9	0.230
10	0.939

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 10

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.224
2	1.000
3	0.132
4	0.206
5	0.537
6	0.305
7	0.222
8	0.727
9	0.154
10	0.329

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #10

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #10, p = 0.329 (> .05).

Sample Size — n = 25

Game 1

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.902
2	0.030
3	0.579
4	0.241
5	0.750
6	0.585
7	0.576
8	0.368
9	0.780
10	0.314

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Not supported by p-values — at least one sample had p ≤ .05 (e.g., Sample #2: 0.030).

Game 2

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.750
2	0.888
3	0.884
4	0.664
5	0.029
6	0.073
7	0.408
8	0.443
9	0.152
10	0.537

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Not supported by p-values — at least one sample had p ≤ .05 (e.g., Sample #5: 0.029).

Game 3

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.073
2	0.646
3	0.578
4	0.253
5	0.009
6	0.359
7	1.000
8	0.005
9	0.441
10	0.885

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #5

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #5 (0.009).

Game 4

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.156
2	1.000
3	0.400
4	0.426
5	0.464
6	0.445
7	0.948
8	0.969
9	0.314
10	0.469

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 5

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.903
2	0.216
3	0.304
4	0.977
5	0.601
6	0.329
7	0.423
8	0.698
9	0.879
10	0.693

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 6

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.520
2	0.158
3	0.381
4	0.835
5	0.304
6	0.723
7	0.430
8	0.078
9	0.886
10	0.206

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #7

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #7, p = 0.430 (> .05).

Game 7

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.399
2	0.497
3	0.945
4	0.836
5	0.311
6	0.416
7	0.432
8	0.374
9	0.735
10	0.635

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #5

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #5, p = 0.311 (> .05).

Game 8

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	1.000
2	0.340
3	0.291
4	0.773
5	0.813
6	0.819
7	0.870
8	0.947
9	0.943
10	0.319

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 9

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.086
2	0.210
3	0.064
4	0.354
5	0.752
6	0.622
7	0.924
8	0.783
9	0.048
10	0.911

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Not supported by p-values — at least one sample had p ≤ .05 (e.g., Sample #9: 0.048).

Game 10

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.975
2	0.976
3	0.858
4	0.004
5	0.005
6	0.373
7	0.976
8	0.933
9	0.646
10	0.105

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #5

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #5 (0.005).

Sample Size — n = 100

Game 1

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.398
2	0.210
3	0.226
4	0.054
5	0.345
6	0.960
7	0.438
8	0.821
9	0.322
10	0.012

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #10

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #10 (0.012).

Game 2

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.668
2	0.435
3	< 0.001
4	0.373
5	0.359
6	0.308
7	0.129
8	0.617
9	0.768
10	0.934

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #3

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #3 (< 0.001).

Game 3

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.345
2	0.310
3	0.849
4	0.047
5	0.492
6	0.340
7	0.378
8	< 0.001
9	0.741
10	0.844

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #8

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #8 (< 0.001).

Game 4

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.432
2	0.759
3	0.544
4	0.006
5	0.315
6	0.272
7	0.323
8	0.867
9	0.559
10	0.149

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Not supported by p-values — at least one sample had p ≤ .05 (e.g., Sample #4: 0.006).

Game 5

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.161
2	0.900
3	0.395
4	0.679
5	0.509
6	0.412
7	0.582
8	0.941
9	0.769
10	0.805

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 6

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.363
2	0.792
3	0.429
4	0.221
5	0.284
6	0.823
7	0.441
8	< 0.001
9	0.862
10	0.808

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #8

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #8 (< 0.001).

Game 7

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.656
2	0.128
3	0.116
4	0.974
5	0.018
6	0.360
7	0.763
8	0.069
9	0.440
10	0.339

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #5

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #5 (0.018).

Game 8

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.379
2	0.877
3	0.636
4	0.622
5	0.308
6	0.863
7	0.624
8	0.949
9	0.484
10	0.348

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 9

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.420
2	0.847
3	0.133
4	0.975
5	0.069
6	0.876
7	0.973
8	0.708
9	0.157
10	0.791

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 10

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.358
2	0.602
3	0.860
4	0.944
5	0.339
6	0.905
7	0.413
8	0.305
9	< 0.001
10	0.151

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #9

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #9 (< 0.001).

Sample Size — n = 1000

Game 1

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.808
2	0.721
3	0.278
4	0.833
5	< 0.001
6	0.131
7	0.623
8	0.011
9	0.687
10	0.876

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #5

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #5 (< 0.001).

Game 2

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.814
2	0.501
3	0.199
4	0.450
5	0.444
6	0.682
7	0.691
8	0.303
9	0.621
10	0.866

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 3

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.643
2	0.630
3	0.697
4	0.370
5	0.925
6	0.234
7	0.534
8	0.905
9	0.836
10	0.250

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 4

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.909
2	0.647
3	0.822
4	0.121
5	0.112
6	0.687
7	0.875
8	0.448
9	0.887
10	0.873

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 5

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.229
2	0.530
3	0.858
4	0.814
5	0.498
6	0.461
7	0.524
8	0.642
9	0.639
10	0.872

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 6

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.061
2	0.156
3	0.406
4	0.349
5	0.070
6	< 0.001
7	0.888
8	1.000
9	0.581
10	0.509

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #6

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #6 (< 0.001).

Game 7

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.154
2	0.673
3	0.859
4	0.086
5	0.681
6	0.611
7	0.687
8	0.601
9	< 0.001
10	0.034

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #9

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #9 (< 0.001).

Game 8

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.376
2	0.883
3	0.091
4	0.910
5	0.646
6	0.975
7	0.890
8	0.308
9	0.119
10	0.875

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 9

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.057
2	0.670
3	0.908
4	0.390
5	0.939
6	0.196
7	0.870
8	0.963
9	0.595
10	0.575

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 10

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.944
2	0.106
3	0.508
4	0.136
5	0.497
6	0.287
7	0.267
8	0.118
9	0.689
10	0.061

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Effect Size — Large (≈ d=0.8)

Sample Size — n = 5

Game 1

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.721
2	0.751
3	0.497
4	0.618
5	0.595
6	0.940
7	0.103
8	0.387
9	0.642
10	0.409

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 2

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.024
2	0.266
3	0.524
4	0.182
5	0.621
6	0.317
7	0.627
8	0.629
9	0.022
10	0.474

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Not supported by p-values — at least one sample had p ≤ .05 (e.g., Sample #9: 0.022).

Game 3

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.684
2	0.862
3	0.909
4	0.353
5	0.887
6	1.000
7	0.305
8	0.655
9	0.514
10	0.718

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 4

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.829
2	0.785
3	0.643
4	0.769
5	0.007
6	0.357
7	1.000
8	0.526
9	0.182
10	0.889

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Not supported by p-values — at least one sample had p ≤ .05 (e.g., Sample #5: 0.007).

Game 5

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.199
2	0.584
3	0.845
4	0.009
5	0.009
6	0.473
7	0.652
8	0.729
9	0.481
10	0.200

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #4

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #4 (0.009).

Game 6

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.381
2	0.438
3	0.324
4	0.062
5	0.772
6	0.454
7	0.890
8	0.605
9	0.567
10	0.184

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 7

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.833
2	0.593
3	0.773
4	0.014
5	0.677
6	0.849
7	0.405
8	0.733
9	0.591
10	0.855

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #7

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #7, p = 0.405 (> .05).

Game 8

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.149
2	0.924
3	0.687
4	0.176
5	0.943
6	0.744
7	0.505
8	0.142
9	0.463
10	0.563

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #8

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #8, p = 0.142 (> .05).

Game 9

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.130
2	0.003
3	0.357
4	0.479
5	1.000
6	0.121
7	0.606
8	0.116
9	0.319
10	0.801

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Not supported by p-values — at least one sample had p ≤ .05 (e.g., Sample #2: 0.003).

Game 10

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.595
2	0.775
3	0.194
4	0.234
5	0.018
6	0.935
7	0.728
8	0.944
9	0.314
10	0.948

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #3

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #3, p = 0.194 (> .05).

Sample Size — n = 25

Game 1

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.133
2	0.534
3	0.742
4	0.293
5	0.236
6	0.816
7	0.035
8	0.743
9	0.052
10	0.285

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Not supported by p-values — at least one sample had p ≤ .05 (e.g., Sample #7: 0.035).

Game 2

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.809
2	0.581
3	0.031
4	0.194
5	0.189
6	0.884
7	0.171
8	0.054
9	0.636
10	0.122

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #8

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #8, p = 0.054 (> .05).

Game 3

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.648
2	0.028
3	0.031
4	0.487
5	0.868
6	< 0.001
7	1.000
8	0.094
9	0.007
10	0.943

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #6

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #6 (< 0.001).

Game 4

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.877
2	0.886
3	< 0.001
4	0.475
5	0.342
6	0.140
7	0.387
8	0.657
9	0.672
10	0.291

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #3

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #3 (< 0.001).

Game 5

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.367
2	0.357
3	0.361
4	0.531
5	0.020
6	0.382
7	0.978
8	0.935
9	0.465
10	0.261

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #5

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #5 (0.020).

Game 6

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.524
2	0.306
3	0.041
4	0.711
5	0.188
6	0.386
7	0.519
8	0.386
9	0.528
10	0.920

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Not supported by p-values — at least one sample had p ≤ .05 (e.g., Sample #3: 0.041).

Game 7

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.082
2	0.968
3	0.181
4	0.091
5	0.098
6	0.062
7	0.410
8	0.137
9	0.947
10	0.374

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #8

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #8, p = 0.137 (> .05).

Game 8

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.391
2	0.784
3	0.972
4	0.402
5	0.004
6	0.692
7	0.857
8	0.106
9	0.329
10	0.386

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #6

p-value Rule Check (for this pretend scenario): Not supported by p-values — for Sample #6, p = 0.692 (> .05).

Game 9

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.370
2	0.240
3	0.062
4	0.545
5	0.287
6	0.593
7	< 0.001
8	0.404
9	0.956
10	0.843

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #7

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #7 (< 0.001).

Game 10

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.949
2	0.471
3	0.972
4	0.031
5	0.678
6	0.054
7	0.294
8	0.870
9	0.444
10	0.905

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Not supported by p-values — at least one sample had p ≤ .05 (e.g., Sample #4: 0.031).

Sample Size — n = 100

Game 1

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.330
2	0.190
3	0.317
4	0.365
5	0.122
6	0.781
7	0.064
8	0.262
9	0.116
10	0.190

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 2

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.503
2	0.286
3	0.232
4	0.280
5	0.423
6	0.381
7	0.733
8	0.852
9	0.892
10	0.121

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 3

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	< 0.001
2	0.731
3	0.196
4	0.639
5	0.462
6	0.544
7	0.097
8	0.425
9	0.207
10	0.632

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #1

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #1 (< 0.001).

Game 4

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.719
2	0.018
3	0.737
4	0.788
5	0.565
6	0.051
7	0.988
8	0.138
9	0.040
10	0.308

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Not supported by p-values — at least one sample had p ≤ .05 (e.g., Sample #2: 0.018).

Game 5

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.307
2	0.948
3	0.552
4	0.802
5	0.593
6	0.040
7	0.688
8	0.149
9	0.831
10	< 0.001

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #10

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #10 (< 0.001).

Game 6

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.962
2	0.304
3	0.119
4	0.386
5	0.901
6	0.736
7	0.731
8	0.406
9	< 0.001
10	0.891

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #9

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #9 (< 0.001).

Game 7

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.660
2	0.488
3	0.146
4	0.135
5	0.922
6	0.783
7	0.113
8	0.598
9	0.671
10	0.434

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 8

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.455
2	0.178
3	0.666
4	0.539
5	0.247
6	0.015
7	0.077
8	0.611
9	0.114
10	< 0.001

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #10

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #10 (< 0.001).

Game 9

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.814
2	0.677
3	0.053
4	1.000
5	0.652
6	0.156
7	0.974
8	< 0.001
9	0.958
10	0.919

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #8

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #8 (< 0.001).

Game 10

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	< 0.001
2	0.830
3	0.214
4	0.544
5	0.693
6	0.613
7	0.796
8	0.353
9	0.599
10	0.037

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #1

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #1 (< 0.001).

Sample Size — n = 1000

Game 1

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.186
2	0.474
3	0.900
4	0.023
5	0.174
6	< 0.001
7	0.239
8	0.585
9	0.624
10	0.967

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #6

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #6 (< 0.001).

Game 2

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.861
2	0.911
3	0.141
4	0.920
5	0.650
6	0.856
7	0.356
8	< 0.001
9	0.027
10	0.129

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #8

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #8 (< 0.001).

Game 3

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.877
2	< 0.001
3	0.650
4	0.258
5	0.632
6	0.193
7	0.476
8	0.123
9	0.660
10	0.992

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #2

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #2 (< 0.001).

Game 4

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.565
2	0.037
3	0.717
4	0.795
5	0.348
6	0.944
7	0.761
8	0.428
9	0.622
10	0.433

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Not supported by p-values — at least one sample had p ≤ .05 (e.g., Sample #2: 0.037).

Game 5

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.634
2	0.660
3	0.741
4	0.451
5	0.742
6	0.490
7	0.723
8	0.659
9	0.035
10	0.627

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Not supported by p-values — at least one sample had p ≤ .05 (e.g., Sample #9: 0.035).

Game 6

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.689
2	0.157
3	0.983
4	0.174
5	0.488
6	0.983
7	0.361
8	0.282
9	0.244
10	0.992

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 7

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.752
2	0.219
3	0.974
4	0.218
5	0.783
6	< 0.001
7	0.406
8	0.940
9	0.681
10	0.267

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #6

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #6 (< 0.001).

Game 8

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.104
2	0.296
3	0.255
4	0.335
5	0.362
6	0.633
7	0.099
8	0.642
9	0.731
10	0.214

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Game 9

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.563
2	0.620
3	0.751
4	< 0.001
5	0.543
6	0.483
7	0.705
8	0.917
9	0.372
10	0.681

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Reject Sample #4

p-value Rule Check (for this pretend scenario): Correct — you rejected the null and p ≤ .05 for Sample #4 (< 0.001).

Game 10

p-values for Ten Samples (two-tailed one-sample t-test, α = .05)
Sample	p-value
1	0.244
2	0.882
3	0.442
4	0.255
5	0.721
6	0.950
7	0.355
8	0.462
9	0.355
10	0.974

Decision prompt: Which sample, if any, should lead you to reject the null hypothesis? Or should the null be retained for all ten?

Answer: Retain Null in all cases

p-value Rule Check (for this pretend scenario): Correct — you retained the null and all p-values were greater than .05.

Methodology & Notes

Population. Scores are integers from 5 to 35. We simulate a truncated normal so the truncated population has mean μ = 24 and SD = 6. Samples are independently drawn with the same truncation and integer rounding.

Effect sizes. For Small, Medium, and Large we shift exactly one sample’s underlying mean by approximately d = 0.2, 0.5, 0.8 (i.e., +1.2, +3.0, +4.8). In roughly half of the games, no sample is shifted.

Testing. p-values are from two-tailed one-sample t-tests against μ = 24; df = n − 1. The decision rule uses α = .05. Values are shown to three decimals; p < 0.001 is displayed as “< 0.001”.

Instructions (p-value focus)

Effect Size — Small (≈ d=0.2)

Sample Size — n = 5

Game 1

Game 2

Game 3

Game 4

Game 5

Game 6

Game 7

Game 8

Game 9

Game 10

Sample Size — n = 25

Game 1

Game 2

Game 3

Game 4

Game 5

Game 6

Game 7

Game 8

Game 9

Game 10

Sample Size — n = 100

Game 1

Game 2

Game 3

Game 4

Game 5

Game 6

Game 7

Game 8

Game 9

Game 10

Sample Size — n = 1000

Game 1

Game 2

Game 3

Game 4

Game 5

Game 6

Game 7

Game 8

Game 9

Game 10

Effect Size — Medium (≈ d=0.5)

Sample Size — n = 5

Game 1

Game 2

Game 3

Game 4

Game 5

Game 6

Game 7

Game 8

Game 9

Game 10

Sample Size — n = 25

Game 1

Game 2

Game 3

Game 4

Game 5

Game 6

Game 7

Game 8

Game 9

Game 10

Sample Size — n = 100

Game 1

Game 2

Game 3

Game 4

Game 5

Game 6

Game 7

Game 8

Game 9

Game 10