Category: Machine learning

It is basically bagging decision tree. Say we can bootstrap $latex M$ dataset from the original dataset. We then train each bootstrap dataset by a decision tree algorithm, to ensure diversity and reduce complexity, only $latex k \approx \sqrt{d}$ dimensions, where $latex d$ is original dimension. The nice thing of random forest is that it…

Came across a presentation that mentioned transductive learning (in contrast to inductive learning). I didn’t know this terminology before. Wiki gave a very good introduction. The term was coined by Vapnik in the 90s, where he believes transductive is better. The original term came from psychology. Inductive reasoning came from logic, while transductive reasoning came…

I always forgot which problem multi-armed bandits actually refer to. I vagulely recalled the one-armed bandit as the slot machine. But I often was confused about that. As a non-native speaker, I first learned the word bandit from playing RPG games as a kid. When I learned that a slot machine can also be referred…

A great fun demo of transformers here.