ZhiZhi Gewu

Sign in Subscribe

ZhiZhi Gewu

[Write to Learn] How Exploring Can Increase Long-Term Reward? An Illustration Using Epsilon-Greedy Method.

[Write to Learn] How Exploring Can Increase Long-Term Reward? An Illustration Using Epsilon-Greedy Method.

The example presented in Reinforcement Learning: An Introduction by Sutton and Barto. A possible value added by this article is to provide a more detailed explanation and code snippets to replicate the example. The 10-armed Bandit Example For readers not familiar with the k-armed bandit problem, you are repeatedly faced

How to Determine the Sample Size of AB Test?

How to Determine the Sample Size of AB Test?

TLDR For two groups with a two-sided alternative, normal distribution with homogeneous variances ( \(\sigma_0^2 = \sigma_1 ^2 = \sigma ^2)\) and equal sample sizes (\(n_0 = n_1 = n\)), \[n = \frac{16}{\Delta^2}\] where \[\Delta = \frac{\mu_0 - \mu_1}{\sigma} = \frac{\delta}{\sigma}\] Examples: What sample

🌟 Zhizhi Gewu's Build in Public Weekly Digest 🌟

🌟 Zhizhi Gewu's Build in Public Weekly Digest 🌟

Hello Brilliant Minds and Passionate Creators, Welcome to this week’s edition of our journey together in the fascinating world of "Building in Public." Each step we take is a story of discovery, learning, and sharing, aimed at not just building projects but fostering a vibrant community of

From the Andes to the Amazon: How Geography Shapes Latin America

From the Andes to the Amazon: How Geography Shapes Latin America

I wouldn't say I liked geography in secondary school. It seemed disconnected from the real world – all about memorising facts and theories. It wasn't until I read 'Guns, Germs, and Steel' that I grasped geography's profound influence on cultures and economies. From

If I were to write a practical guide on consumer loan credit risk management, this is what the content page would look like.

If I were to write a practical guide on consumer loan credit risk management, this is what the content page would look like.

1. Fundamentals 1. The Art and Science of Decision-Making 2. Fundamentals of Interest and Loan 2. Key Objective and Its Components 1. The Balance Between Risk and Reward 2. Commonly Used Risk Metrics 3. Prediction into the Future 1. Estimating Long-term Impact from Short-term Outcome 2. Creating Models of the

Resources to Understand the Difference between Potential Outcome Model and Structural Causal Model

Resources to Understand the Difference between Potential Outcome Model and Structural Causal Model

This week, I compared the difference between the Potential Outcome Model (Rubin Casual Model) and Structural Causal Model frameworks for causal inference. I failed to grasp the difference between the two. Still, I can share some resources on this matter. While I believe the comparison has more of a theoretical

The Bias of Using Observational Data to Estimate Causal Effect

The Bias of Using Observational Data to Estimate Causal Effect

Let's consider the effect of college attendance on an individual's mental ability. We find that individuals who have attended college score higher than those who have not. What are the possible reasons? Does college attendance cause an increase in mental ability? There are three possible explanations.