ZhiZhi Gewu

Reading is a beacon of knowledge in the lifelong learning journey, offering pathways to myriad destinations. Yet, as I reflect on my reading habits, I've come to recognise the existence of distinct reading methodologies, each serving a unique purpose in the quest for understanding. 1. The Quest for

Recently, I have been reading Reinforcement Learning: An Introduction by Sutton and Barto. In Chapter 3, Session 5, I found the derivation of the Bellman Equation hard to follow. I hope this supplementary note can provide information to the coming students. The section contains all the necessary information to understand

The example presented in Reinforcement Learning: An Introduction by Sutton and Barto. A possible value added by this article is to provide a more detailed explanation and code snippets to replicate the example. The 10-armed Bandit Example For readers not familiar with the k-armed bandit problem, you are repeatedly faced

TLDR For two groups with a two-sided alternative, normal distribution with homogeneous variances ( \(\sigma_0^2 = \sigma_1 ^2 = \sigma ^2)\) and equal sample sizes (\(n_0 = n_1 = n\)), \[n = \frac{16}{\Delta^2}\] where \[\Delta = \frac{\mu_0 - \mu_1}{\sigma} = \frac{\delta}{\sigma}\] Examples: What sample

Hello Brilliant Minds and Passionate Creators, Welcome to this week’s edition of our journey together in the fascinating world of "Building in Public." Each step we take is a story of discovery, learning, and sharing, aimed at not just building projects but fostering a vibrant community of