No Support Beyond Reach: The Measure Centrality Index 2.0 and Adversarial Comparisons of Consciousness Theories

summary

The gist

A success in adversarial testing of scientific theories reaches only as deep as its matching failure would have cut…

In short

The Measure Centrality Index 2.0 enforces a constraint where scientific support for theories of consciousness can only reach as deep as its corresponding matching failure would have cut. It introduces machinery to record what a success counts against and what the theory proponent agrees to change, preventing results from being claimed beyond their established limits.

Key concepts

Measure Centrality Index 2.0 (MCI 2.0)
A tool that extends original indices to the positive-evidence side. It records for every possible outcome what it would count against and what the proponent has agreed to change, ensuring success depth matches failure depth.
One-Way Evidential Ratchet
An asymmetry in adversarial testing where a preregistered prediction can be claimed as evidence for the whole program, while failures are absorbed by auxiliary tools. This happens when attribution is settled after the outcome is known.
Reach Principle
The rule stating that support for a theory may only be claimed to the depth where a matching failure would have cut under the same assumptions. It constrains where public support can be asserted.
Success/Failure Depth Matching
The core constraint: a success counts for a target only if the matching failure would have counted against that same target. This is enforced by recording test objects that define the comparison and depth order.

Terminology used across episodes

This episode discusses

The paper

No Support Beyond Reach: The Measure Centrality Index 2.0 and Adversarial Comparisons of Consciousness Theories · Read on arXiv

Sussex Centre for Consciousness Science · University of Sussex

A success in adversarial testing of scientific theories reaches only as deep as its matching failure would have cut. I call this the Reach Principle, and the goal of this chapter is to build the instrument that enforces it. Adversarial tests of consciousness theories can turn into a one-way evidential ratchet. When a preregistered prediction passes, the success is claimed for the research program; when it fails, the failure lands on an auxiliary involved in measurement or implementation. The ratchet turns wherever attribution is settled after the outcome is known. Against it, I define a preregisterable test object, putting the attribution policy on the record before the result, comprising what is compared, under which assumptions, when data suffice to settle an outcome, and which targets of a dated theory version each outcome exposes. The Measure Centrality Index 2.0 extends the original version to the positive-evidence side, recording for every possible outcome what it would count against and what its proponent has agreed to change. I run the framework on Cogitate's third prediction, where the preregistered target was the posterior-connectivity implementation and the mathematical or computational core of both Global Neuronal Workspace Theory and Integrated Information Theory stood outside the test. The record shows that a pass could have been claimed at any depth, because nothing fenced success the way the failure was bound. The next preregistration can set reach in advance, and support for a theory then reaches only what was exposed ex ante.

Transcript

Introduction to the show: ident: Genomics Radio. Generated commentary on the latest computational biology and genomics papers.

Ines: We're looking at the paper: "No Support Beyond Reach".

Marcus: Here's the gist of the paper. A success in adversarial testing of scientific theories reaches only as deep as its matching failure would have cut, and this paper introduces the Measure Centrality Index 2.0 to enforce this constraint The Measure Centrality Index 2.0 extends the original version to the positive-evidence side, recording for every possible outcome what it would count against and what its proponent has agreed to change The One-Way Evidential Ratchet Adversarial tests of theories of consciousness (ToC) can acquire a characteristic asymmetry where a preregistered prediction passing may be claimed as evidence for the whole research program, while failure is absorbed by auxiliary apparatuses This asymmetry is termed the one-way evidential ratchet, which operates whenever the attribution of an outcome to a theoretical target is settled after the outcome is known.

Ines: The first experiment in the adversarial collaboration between GNWT and IIT serves as an example of this attribution risk, where theory proponents could anticipate revising implementations while retaining cores.

Marcus: What the Measure Centrality Index is for The MCI 2.0 specifies how far a success reaches, holding it to the same level as how deep a failure cuts.

Ines: It builds machinery that keeps this record, specifying what is compared, under which assumptions, when data suffice to settle an outcome, and which targets of a dated theory version each outcome exposes.

Title and authors: Marcus: So we're looking at this paper now titled "No Support Beyond Reach: The Measure Centrality Index two point zero and Adversarial Comparisons of Consciousness Theories <ref:2611.06925#pg1,No Support Beyond Reach: The Measure Centrality Index 2.0 and Adversarial>." It sounds like they’re building a way to make sure when you test a theory of consciousness, the support you get is actually tied to how deep the failure would have cut.

Ines: Exactly. It’s about fixing this problem where a passing prediction gets treated as proof for the whole research program, while if it fails, they just blame some tool or measurement setup. This paper introduces something called the Measure Centrality Index two point zero to enforce that constraint on the positive evidence side too <ref:2611.06925#pg1,the Measure Centrality Index 2.0>.

Yuki: It sounds like they are trying to create a fairer way to measure support for different theories of consciousness, making sure you don't claim more support than what's actually there based on how sensitive the test is.

Marcus: Right. Before this, we had this one-way evidential ratchet where you could get credit for the whole program just because a prediction passed, even if it failed to rule out some parts of it. This new index is designed to stop that by recording what each outcome would count against and what the proponents have already agreed to change.

Ines: It’s about making the test object itself record all that stuff before any data comes in, which is a big deal for controlling how we interpret experimental results in this area.

The paper's summary: Ines: Basically, the Measure Centrality Index two point zero extends the original version to look at success instead of just failure, and it specifies exactly how far that success reaches by holding it to the same level as where a failure would have cut <ref:2611.06925#pg1,the Measure Centrality Index 2.0 extends the original version to>. They build this machinery to track what is being compared, under what assumptions, and which parts of an older theory get exposed by a certain outcome.

Marcus: What's interesting about the summary is that they’re not just looking at one thing; they are building something that records the two things: what each possible outcome would count against, and what the proponent has already agreed to change based on that test. That’s a lot of bookkeeping before you even get any data.

Yuki: I think this means they are trying to define a concrete boundary for where support can be claimed in public debate about consciousness theories, tying it directly to the depth of potential failure.

Ines: That's right. The core idea is the Reach Principle, which says support for a theory can only be claimed as deep as the matching failure would have cut under the same conditions. They’re using this index to record that comparison, which includes things like what is compared and what targets of a dated theory version each outcome exposes, in one single document before we look at the actual results.

Marcus: And they use this to stop that ratchet because by recording all those options side-by-side before the data arrives, they ensure that the success travels exactly as far as the matching failure would have along a path that theory itself agreed to. It’s about timing attribution before you know what happened.

The paper's improvements: Ines: The authors suggest several ways to improve this framework, focusing on how it handles objections and neighbors from other theories of consciousness. They specifically address the Bayesian modeling objection where a theory's core might make a successful implementation look more expected, while failure updating lands on a fragile auxiliary apparatus.

Marcus: And they also tackle the second objection that preregistered exposure limits room for theories to grow by proposing a successor rule. This rule says that when you revise a theory or test with new data, it becomes a new object and only inherits support through what stayed unchanged after testing.

Yuki: That successor rule sounds like an important mechanism for tracking evolution; it means if you change something, the old support doesn't just vanish; it has to pass on through the parts that weren't modified. That’s crucial for understanding how concepts evolve in this field.

Ines: And they suggest incorporating a path pi into the test object. This records exactly which links a given measure depends on, which helps you differentiate between different versions of the theory based on their specific dependencies, addressing issues where structural centrality can’t settle what a result may be taken to show.

Marcus: It sounds like they are trying to make the record much more detailed about the evidence sensitivity itself. They want to prevent situations where we can't settle what a result might actually be pointing toward because of how deeply it depends on certain parts of the measurement setup.

Conclusion: Ines: So, to wrap up, this paper with its Measure Centrality Index two point zero is about enforcing the Reach Principle by recording what each possible outcome would count against and what the proponent has agreed to change before any data is seen <ref:2611.06925#pg1,Measure Centrality Index 2.0>. It’s designed to stop that one-way evidential ratchet by tying success directly to the depth of potential failure, making sure support travels only along paths the theory itself agreed to.

Marcus: Right. The improvements they suggest, like having a successor rule for revisions and recording exactly which links measures depend on via path pi, help make this record much more robust against objections from things like Bayesian modeling or concerns about theories stagnating when you test them repeatedly.

Yuki: I think the main implication for us is that we need this kind of pre-registration to be extremely detailed about the entire comparison setup, including all those negative targets from which each deepest exposed target follows, so we can actually see where the support ends.

Ines: Exactly. The whole point is to make sure that when a prediction passes, it doesn't automatically mean you’ve proven the whole research program; it has to be demonstrably as deep as what a matching failure would have cut in the first place. That’s what "No Support Beyond Reach: The Measure Centrality Index two point zero and Adversarial Comparisons of Consciousness Theories" is all about <ref:2611.06925#pg1,No Support Beyond Reach: The Measure Centrality Index 2.0 and Adversarial>.

More episodes

← Home