A formal note · IV
Stochastic memetic replication and the categorical replicator–mutator equation
Selection, mutation, semantic coarse-graining, and evolutionary dynamics in an ∞-topos.
probability monad / fitness / Markov kernel / transfer operator / lumpability
Abstract
We extend the ∞-topos and network-theoretic formulation of memetic replication from deterministic transformations to stochastic population dynamics.
Let
be a cognitive semantic ∞-topos, and let be an object of semantic memetic classes. Since probability is not canonically determined by an arbitrary ∞-topos, we assume explicitly that is equipped with a commutative probability monad
or, equivalently for the present purposes, with a compatible Markov-category structure.
A population is a probability state
Selection is specified by a positive fitness observable
while mutation and imperfect transmission are represented by a Markov kernel
The resulting discrete-time evolutionary operator is
Equivalently, introducing the positive transfer operator , one has
For a finite semantic state space this becomes the classical replicator–mutator equation
We prove normalization, characterize stationary populations as positive eigenmeasures of the transfer operator, derive both continuous-time replicator and mutation–selection equations, establish a coarse-graining theorem showing precisely when observer-relative semantic quotients inherit closed Markovian dynamics, and derive the Perron–Frobenius asymptotics of finite primitive systems.
The resulting framework identifies stochastic memetic evolution with normalized positive dynamics on capability-relative semantic classes. The deterministic theories are Note I, Note II, and Note III.
Notation
The symbols of this note, in the order they become active.
- Semantic state object: the distinctions an observer retains.
- A commutative probability monad on the cognitive ∞-topos.
- A population: a probability state on semantic classes.
- Positive fitness. Mean fitness is the integral of w against μ.
- A Markov kernel. Mutation, noise, and imperfect transmission.
- Selection: reweight μ by fitness and renormalize.
- The replicator–mutator operator, selection followed by mutation.
- The positive transfer operator. Evolution is its projectivization.
- Finite mutation matrix. Rows are probability distributions.
- A coarse-graining. Dynamics on the quotient closes only when it is lumpable.
1Semantic state space
Let be a cognitive ∞-site and let
Let be an underlying object of memetic realizations, and let be a semantic observable, localization, or quotient. The object is the semantic state object.
Two realizations are equivalent relative to when . Thus represents the memetic distinctions retained by the observer or cognitive architecture under consideration.
2Probability structure
Probability is additional structure. An arbitrary ∞-topos does not by itself determine a canonical notion of probability measure. We therefore assume the following.
Remark2.1Probability monad
The ∞-topos is equipped with a commutative probability monad
with unit
and multiplication
We assume sufficient integration structure to make expressions of the form
well defined for suitable internal nonnegative real-valued functions . In ordinary measurable spaces one may take the Giry probability monad. For finite objects, is the probability simplex on .
3Markov kernels
Definition3.1Stochastic memetic transformation
A stochastic transformation from to is a Kleisli morphism
We call such a morphism a Markov kernel. For , the probability state describes the distribution of possible outputs conditional on input .
Definition3.2Composition
If and , their Kleisli composite
is defined by
In ordinary integral notation,
Thus stochastic transmission is closed under composition.
4Population states
Definition4.1Population distribution
A memetic population state on is a probability state
The space of populations is therefore . For finite , we identify with a vector satisfying
5Fitness
Definition5.1Fitness observable
A fitness function is a positive semantic observable
For a state , the value is its expected reproductive weight. The population mean fitness is
We assume for every population under consideration.
6Selection
Definition6.1Selection operator
The fitness-weighted population is the probability distribution defined by
Equivalently, for an event ,
Proposition6.2Selection preserves normalization
By definition the numerator and the denominator are the same integral:
7Mutation and imperfect transmission
Definition7.1Mutation kernel
A mutation kernel is a Markov kernel
For , the distribution describes the possible semantic type of an offspring or transmitted realization originating from . Mutation here includes any stochastic failure of exact semantic inheritance:
- copying errors
- reinterpretation
- translation
- recombination noise
or any other probabilistic change of semantic class.
8Pushforward through a Markov kernel
A kernel induces a map on populations
given by
Proposition8.1Mutation preserves probability mass
If is normalized, then is normalized.
Since each is a probability measure, . Hence
9The categorical replicator–mutator operator
We now compose selection and mutation.
Definition9.1Replicator–mutator operator
Define
Thus
Explicitly, for an event ,
10Normalization theorem
Theorem10.1The operator preserves probability
For every probability distribution , is again a probability distribution.
Selection produces a probability state by Proposition 6.2. The Markov pushforward preserves probability mass by Proposition 8.1. Therefore their composite does also.
Thus
defines a dynamical system on the population simplex.
11The positive transfer operator
Normalization hides a useful linear structure. Let denote the cone of finite nonnegative measures on .
Definition11.1Mutation–selection transfer operator
Define
by
Equivalently, , where . The operator is positive and linear on finite measures.
Proposition11.2Total mass is mean fitness
For a probability measure , .
Corollary11.3Projectivization
The replicator–mutator operator is the projectivization of the positive transfer operator:
This is the basic categorical structure behind the theory. Evolution takes place in the projectivization of a positive cone.
12Finite-state form
Let . Write , let , and define . The matrix is row-stochastic:
Theorem12.1Finite replicator–mutator equation
The categorical operator reduces to
In row-vector notation,
where . Since , this becomes
13Pure replication
Set . Then , and the update becomes
where . This is the discrete replicator equation.
14Pure mutation
If fitness is constant, , then selection is trivial: . Hence
For a finite state space, . Ordinary Markov dynamics is the zero-selection limit of the memetic evolutionary theory.
15Stationary populations
Definition15.1Evolutionary equilibrium
A population is stationary if
16Eigenmeasure theorem
Theorem16.1Equilibria are normalized eigenmeasures
A probability distribution is stationary if and only if
for .
Suppose first that . By Corollary 11.3,
Hence . By Proposition 11.2, . Therefore .
Conversely, suppose . Since has total mass 1, . Therefore
Thus evolutionary equilibrium is a Perron–Frobenius-type eigenproblem.
17Iteration
Proposition17.1Linearization of the orbit
Let . When and are time-independent,
Normalization factors are scalars and therefore cancel under successive projectivization. Induction gives the formula.
The nonlinear normalized dynamics is induced by an underlying positive linear dynamics.
18Perron–Frobenius theorem in the finite case
Let .
Theorem18.1Primitive finite mutation–selection dynamics
Suppose is primitive: there exists such that every entry of is strictly positive. Then:
- has a unique positive dominant eigenvalue .
- There is a unique probability row vector with strictly positive components satisfying .
- is the unique interior fixed point of the replicator–mutator map.
- For every nonzero initial vector ,
This is the Perron–Frobenius theorem for primitive nonnegative matrices applied to . The fixed-point characterization follows from Theorem 16.1. The convergence statement follows from domination of all other eigenvalues in modulus by .
Thus mutation plus selection can produce a unique asymptotic semantic population even though individual replication events remain stochastic.
19Continuous-time pure selection
Let the fitness over a short interval be
With no mutation,
Expanding,
where . Hence
This is the continuous replicator equation.
20Mutation generated continuously
Let be a Markov generator: for , and . Set
where . The finite-step update is
Theorem20.1Continuous selection–mutation equation
The infinitesimal evolution is
Expand
The numerator is therefore
Since , the denominator is . Using gives
The -th component yields the stated equation.
21Mutation at reproduction
There is another standard continuous-time model. Suppose type reproduces at rate , and each offspring has type with probability . Then the production rate of type is . Maintaining constant total population produces
where .
Proposition21.1Conservation of total probability
22Semantic coarse-graining
Return now to observer-relative semantics. Suppose
maps fine-grained memetic states to coarse semantic classes. Let be microscopic fitness and
the microscopic mutation kernel. We ask when there is an induced closed evolutionary dynamics on . This is a categorical lumpability problem.
23Fitness compatibility
Definition23.1Fitness descends through q
Fitness is -observable if there exists such that
Thus all fine states in one semantic equivalence class possess the same fitness.
24Mutation compatibility
Definition24.1Kernel lumpability
The fine mutation kernel is -lumpable if there exists such that
Diagrammatically,
The probability distribution of the coarse offspring type therefore depends only on the coarse parent type.
25Coarse-graining theorem
Let denote pushforward.
Theorem25.1Exact semantic coarse-graining commutes with evolution
Suppose
Then
Let . First consider selection. For a coarse observable ,
Since , the right-hand side is
Hence
Lumpability gives
Therefore
26Consequence for cognitive capability
Suppose is the semantic localization associated with cognitive architecture . Then the population dynamics perceived by is autonomous precisely when both fitness and transition probabilities depend only on . Otherwise the coarse semantic dynamics need not be Markovian.
Corollary26.1Hidden semantic structure can induce apparent memory
If mutation or fitness varies inside the fibers of , then the coarse population process on generally fails to close as a first-order Markov process.
Two fine populations can have the same coarse distribution while having different distributions inside each fiber. If those hidden differences influence reproduction or mutation, then
The next coarse state therefore cannot be determined from the current coarse state alone. Thus insufficient cognitive resolution can convert microscopically Markovian dynamics into apparently non-Markovian dynamics.
27Observer-relative fitness
Fitness itself may depend on the observer or environment. For each architecture , let . Then the same underlying memetic population may possess different induced evolutionary dynamics at different semantic resolutions.
For , compatibility requires
in the appropriate contravariant sense. Without this compatibility, there is no reason for selection to commute with change of observer.
28Replication probability
Let be a semantic equivalence class. A kernel defines a probability that state remains in its class after transmission.
Definition28.1Semantic fidelity
Define
Thus . If is a coarser observer than , then typically . Consequently
provided both classes are measured under the same underlying transmission kernel.
Proposition28.2Coarser semantics weakly increase measured fidelity
If , then .
Probability measures are monotone under inclusion of measurable events.
This is the stochastic analogue of the earlier theorem that coarse observers weakly increase apparent deterministic fidelity.
29Effective reproductive success
For a state , take as exposure or reproductive intensity and as semantic fidelity. A simple capability-relative effective self-reproduction factor is then
More generally, one should retain the full offspring kernel rather than compressing it to a scalar. Nevertheless, the factorization of reproductive intensity by semantic fidelity is useful conceptually.
30Selection of semantic classes
Let be a class of memes. The expected post-reproduction mass entering , before normalization, is
This decomposes evolutionary success into current prevalence, reproductive weight, and transition probability into the target class. A class can increase either because it reproduces rapidly or because other classes mutate into it.
31Mutation–selection balance
At equilibrium,
Hence for every measurable ,
This is the abstract mutation–selection balance equation. The quantity is the asymptotic population growth factor before normalization.
32Multi-parent stochastic recombination
The Markov-kernel formalism also extends the operadic theory of Note II. Let be an object of -ary operations. A stochastic operadic transformation is a kernel
Given parents and an operation , the output is distributed according to .
Definition32.1Parent-relative stochastic fidelity
Relative to parent ,
is the probability that the recombination event preserves the semantic class of the -th parent. Deterministic operadic replication is recovered when the kernel is a Dirac distribution.
33Stochastic network semantics
More generally, replace deterministic network morphisms by stochastic morphisms . Sequential network composition becomes Kleisli composition. Parallel composition is supplied by commutativity of the probability monad. Hence a probabilistic memetic network defines
Its semantics is a conditional probability law rather than a deterministic function.
34Replication relative to an observable
Let be a semantic observable. For an input , the output semantic distribution is . If the target semantic class associated with is represented by , then exact stochastic replication means
Approximate replication permits a nonzero error distribution around this Dirac state.
35Error kernel
Define the semantic error kernel by
The deterministic theory corresponds to the special case in which is always a Dirac measure. The stochastic theory instead retains the entire distribution . Thus mutation is not a Boolean event but a probability distribution over semantic deviations.
36Categorical evolutionary hierarchy
The successive theories now form the hierarchy
At each stage, the earlier theory is recovered by restriction. A deterministic morphism embeds into stochastic dynamics through the Dirac kernel .
37Full stochastic specification
The resulting model is the tuple
| Symbol | Meaning |
|---|---|
| Cognitive architectures. | |
| Coverage. | |
| Semantic ∞-topos. | |
| Probability monad. | |
| Fine memetic realization object. | |
| Semantic quotient. | |
| Semantic class object. | |
| Positive fitness. | |
| Mutation or transmission kernel. |
The evolutionary operator is
38Main theorem
Theorem38.1Categorical replicator–mutator theorem
Let be a cognitive semantic ∞-topos equipped with a compatible probability monad . Let , let , and let . Then:
- (i) Selection defines a normalization-preserving map . See Proposition 6.2.
- (ii) The Markov kernel induces a probability-preserving pushforward . See Proposition 8.1.
- (iii) Their composite defines a discrete-time population dynamical system. See Definition 9.1.
- (iv) This nonlinear system is the projectivization of the positive linear operator . See Corollary 11.3.
- (v) Its stationary populations are precisely normalized positive eigenmeasures of . See Theorem 16.1.
- (vi) For finite semantic state spaces it reduces toSee Theorem 12.1.
- (vii) Its infinitesimal pure-selection limit is . See Section 19.
- (viii) With a continuous mutation generator , its infinitesimal limit is . See Theorem 20.1.
- (ix) A semantic quotient inherits closed replicator–mutator dynamics whenever fitness is constant on its fibers and the microscopic mutation kernel is -lumpable. See Theorem 25.1.
- (x) Failure of these conditions can make a coarse observer perceive non-Markovian dynamics even when the underlying dynamics is Markovian. See Corollary 26.1.
39Conceptual consequence
The deterministic theory characterized memetic replication as preservation of a semantic invariant:
The stochastic theory replaces this by a conditional distribution over semantic outcomes. Exact inheritance is Dirac-valued. Imperfect inheritance is a Markov kernel on semantic classes.
Population evolution is then obtained by weighting those states by reproductive success and integrating over all transition possibilities. The fundamental operator is
40Final synthesis
The entire theory developed so far can now be compressed into the sequence
Realizations, then semantic classes, then selection, then mutation, then normalization, then population evolution.
At the individual level,
gives a distribution of possible semantic descendants. At the population level,
At equilibrium,
At finite dimension this is a Perron–Frobenius eigenproblem.
At different cognitive resolutions, exact coarse-graining is governed by the commuting square together with . Consequently, cognitive capability does not merely affect which individual transmissions count as faithful. It determines whether the population dynamics itself closes at the observer’s semantic resolution.
The strongest form of the theory is therefore
Normalized positive stochastic dynamics on observer-relative semantic classes.
Equivalently,
This connects the ∞-topos formulation of observer-relative identity directly to Markov kernels, mutation–selection systems, transfer operators, and the classical replicator–mutator equation.