글

라벨이 bayesian-learning인 게시물 표시

Machine Learning (CPSC 540): Bayesian learning

이미지
In the Frequentist's view, they treat event that can be repeated many times. They use just likelihood for the prediction and they regard the parameter $\theta$ as a fixed constant. However, in the Bayesian's view, they regard the $\theta$ as a random variable and they set a prior hypothesis (or initial belief) to the $\theta$. This view is useful when the event can not be repeated many times and for solving reverse problems. Generally, reverse problem is much harder, for example, it is easy to transform text to sound but reverse problem is hard. Bayesian's view is similar to how machines learns. They have a prior knowledge and that prior knowledge would be updated when machines encounter data. Here, it is good to use conjugate prior for the likelihood function so that posterior distribution are in the same family as the prior probability distribution. We call this conjugate analysis. It is easy to understand Bayesian's view by the example of a coin toss. First, we wan...