Implementing UCB

UCB practice: snapshot at \(t=10\)

Suppose the trial has reached patient \(t=10\), and the observed data so far are:

\(t\) \(d_i\) \(y_i\)
1 A 1
2 A 1
3 A 0
4 A 1
5 A 1
6 A 0
7 A 1
8 B 1
9 B 0
10 B 0
  1. Complete the next assignment, \(d_{11}\), using a Wald-style upper bound.
  2. Complete the next assignment, \(d_{11}\), using a Hoeffding-style upper bound.