I guess I seem to be confused with the partition function from evidence. When they appear together, I don’t seem to be confused. But when they appeared in different contexts, I just got confused like falling into some illusion tricks.
Given data 
and parameter 
, the evidence is simply 
.
And 
, where the denominator 
is the partition function.
How come I could get confused? I guess maybe when we consider the MAP estimate of , we have
, and the denominator is 
. Indeed, they do look a bit similar. Computing should not be necesary for inference as I was confused earlier. But it is needed for model class selection. That is, does the current parametrized models fit well with the data?
On the other hand, we need to know the partition function even for just selecting the model (matching parameter) from the current model class. Since maximizing involves 
already.