Karl Friston - 2016 CCN Workshop: Predictive Coding
24,408
Published 2016-09-02
2016 Workshop: Predictive Coding
KARL FRISTON, UNIVERSITY COLLEGE LONDON
Predictive coding, active inference and belief propagation
Abstract:
I will consider prediction and choice based upon the minimisation of expected free energy. Crucially, (negative) free energy can always be decomposed into pragmatic (extrinsic) and epistemic (intrinsic) value. Minimising expected free energy is therefore equivalent to maximising extrinsic value, while maximising information gain or intrinsic value, i.e., reducing uncertainty about the causes of sensory samples. This decomposition resolves the exploration-exploitation dilemma; where epistemic value is maximised until there is no further resolution of uncertainty, after which exploitation is assured through maximisation of extrinsic value. This is formally consistent with the principle of maximum mutual information, generalising formulations of active vision based upon salience (Bayesian surprise) and optimal decisions based on expected utility and risk sensitive (KL) control - using Hamilton's principle of least action. I will briefly review the normative theory - illustrating the minimisation of expected free energy using simulations and then turn to neuronal processes theories. In brief, the implicit (neuronally plausible) belief propagation offers a form of predictive coding, when hidden causes and outcomes are treated as discrete states.
All Comments (13)
-
The content of this presentation is pure gold.
-
05:41 is the main part that shows why RL type approaches cannot work in certain situations. I just loved it!
-
This video lacks of zooming the presentation :/
-
this man is genuis..the implication of his revolutionary theory Free Energy principle will unfold in the near future.
-
Hi all, where can I learn the math used in this presentation, like translating the real world observation into math? Is there a book, or a tutorial for a novice like me.
-
Thanks so much for sharing
-
-
Link to the slides?
-
48:30 savage 'ahh your question is trivial'
-
The answer to the last unanswered question: "what about surprise seeking" is that when exploitation is complete, the explorer is bored. The rat then seeks surprise to avoid boredom.
-
Typical result whenever neuroscientists try to "explain" how mind works. It's like heart surgeon tries to explain how love works.
-
I used to admire Mr. Friston until he outed himself as a cheap nationalist in his Guardian interview.
