4 Belge Chapter 9: Perception

9.2 The Maximum Entropy Principle

   If the Principle of Indifference tells us what probabilities to assign given no backgroundknowledge, what is the corresponding principle for the case when one does have somebackground knowledge? Seeking to answer this question, E.T. Jaynes studied the writings of J.Willard Gibbs and drew therefrom a rule called the maximum entropy principle. Like thePrinciple of…

9.1 Probability Theory

   The branch of mathematics known as probability theory provides one way of makinginferences regarding uncertain propositions. But it is not a priori clear that it is the onlyreasonable way to go about making such inferences. This is important for psychology because itwould be nice to assume, as a working hypothesis, that the mind uses…

9.0 The Perceptual Hierarchy

   In accordance with the philosophy outlined in Chapter 5, I define perception as patternrecognition. Pattern recognition is, of course, an extremely difficult optimization problem. Infact, the task of recognizing all the patterns in an arbitrary entity is so hard that no algorithm cansolve it exactly — this is implied by Chaitin’s (1987) algorithmic-information-theoretic proof…