← Back to Annotated Bibliography

Super-cooperation-cluster alignment aguments

Linked from Meta/meaningcrisis, game theory, blockchain / Attractors in the Space of Mind Architectures and the Super Cooperation Cluster

This is sort of how the argument comes across to me:

There is some most powerful and agentic thing in the universe; let’s call this God.

One way that you could be powerful and agentic is by being a super-cooperator. Being a super-cooperator might also make you very wise (and forgiving, etc).

Therefore, God must be very wise and forgiving.

There’s a bit of a logical problem with this posing of it, which is apparent if we look at the implications being asserted:

Unfortunately, we can’t get C from A and B, as the implication in A points in the wrong direction. What we need is something like

i.e., the only way to have great power and agency is by being a super-cooperator.

Whether or not A’ and B are actually true seems like it’s actually a fascinating question in the vein of “AI alignment”-style discussions.

Some handwavey initial thoughts:

For A':

All intelligence and capacity in the world is “holonic” in nature. In particular, it consisting of self-organizing parts which respond to local incentives and represent some local implicit utility function.

There is some complexity buzz-saw which keeps “unitary” formations from developing beyond a point. All global objectives will eventually decompose into smaller objectives which parts arise to fulfill.

Since capacity must be implemented by self-interested parts, naturally these parts must somehow cooperate in order for their capacity to aggregate.

For B:

So parts must cooperate. But does this necessarily result in aggregate wisdom “on the edges.” Does the super-cooperator even know about the cooperative dynamics which give rise to its existence.

Counterexamples:

There seem to be some other big pieces, assumptions, that are need for this part. What are the emergent phenomena of a human-level super cooperation cluster? Is there some reason that this phase is necessary in the developmental cycle of a God?