Tuesday, June 2, 2020

Karl Friston On Generative Models & Immunological Dark Matter

How do the models you use differ from the conventional ones epidemiologists rely on to advise governments in this pandemic?

Conventional models essentially fit curves to historical data and then extrapolate those curves into the future. They look at the surface of the phenomenon – the observable part, or data. Our approach, which borrows from physics and in particular the work of Richard Feynman, goes under the bonnet. It attempts to capture the mathematical structure of the phenomenon – in this case, the pandemic – and to understand the causes of what is observed. Since we don’t know all the causes, we have to infer them. But that inference, and implicit uncertainty, is built into the models. That’s why we call them generative models, because they contain everything you need to know to generate the data. As more data comes in, you adjust your beliefs about the causes, until your model simulates the data as accurately and as simply as possible.

[---]

This is the first time the generative approach has been applied to a pandemic. Has it proved itself in other domains?

These techniques have enjoyed enormous success ever since they moved out of physics. They’ve been running your iPhone and nuclear power stations for a long time. In my field, neurobiology, we call the approach dynamic causal modelling (DCM). We can’t see brain states directly, but we can infer them given brain imaging data. In fact, we have pushed that idea even further. We think the brain may be doing its own dynamic causal modelling, reducing its uncertainty about the causes of the data the senses feed to it. We call this the free energy principle. But whether you’re talking about a pandemic or a brain, the essential problem is the same – you’re trying to understand a complex system that changes over time. In that sense, I’m not doing anything new. The data is generated by Covid-19 patients rather than neurons, but otherwise it’s just another day at the office.

You say generative models are also more efficient than conventional ones. What do you mean?

Epidemiologists currently tackle the inference problem by number-crunching on a huge scale, making use of high-performance computers. Imagine you want to simulate an outbreak in Scotland. Using conventional approaches, this would take you a day or longer with today’s computing resources. And that’s just to simulate one model or hypothesis – one set of parameters and one set of starting conditions. Using DCM, you can do the same thing in a minute. That allows you to score different hypotheses quickly and easily, and so to home in sooner on the best one.

[---]

Once the pandemic is over, will you be able to use your models to ask which country’s response was best?

That is already happening, as part of our attempts to understand the latent causes of the data. We’ve been comparing the UK and Germany to try to explain the comparatively low fatality rates in Germany. The answers are sometimes counterintuitive. For example, it looks as if the low German fatality rate is not due to their superior testing capacity, but rather to the fact that the average German is less likely to get infected and die than the average Brit. Why? There are various possible explanations, but one that looks increasingly likely is that Germany has more immunological “dark matter” – people who are impervious to infection, perhaps because they are geographically isolated or have some kind of natural resistance. This is like dark matter in the universe: we can’t see it, but we know it must be there to account for what we can see. Knowing it exists is useful for our preparations for any second wave, because it suggests that targeted testing of those at high risk of exposure to Covid-19 might be a better approach than non-selective testing of the whole population.

- Full interview here

No comments: