Independent scholarship · Open accessThe monthly digest

Indexed text attachment

entropy-sources-and-channels-in-higher-categories.tex

Source for Entropy, Sources, and Channels in Higher Categories

View paper · Download original file

Lines 3549–3648 of 4249. Source text is displayed literally.

3549\textbf{Category} & \textbf{Objects} & \textbf{Morphisms}\\\midrule3550$\FinStoch$ & finite sets & stochastic matrices\\3551$\BorelStoch$ & standard Borel spaces & Markov kernels\\3552$\Stoch$ & measurable spaces & Markov kernels\\3553$\Dyn$ & the same, with an automorphism & equivariant Markov kernels\\3554\bottomrule3555\end{tabular}3556\end{center}3557 3558In $\FinStoch$ and $\BorelStoch$ the deterministic morphisms are the (measurable) maps; in $\Stoch$ they are the3559kernels taking only the values $0$ and $1$. For a state $p$ on $X$ and a morphism $f\colon X\to Y$ the joint3560state $p\rtimes f=(\id\otimes f)\circ\cpy\circ p$ on $X\otimes Y$ has marginals $p$ and $f\circ p$.3561 3562$\CC$ \term{has conditionals} if every morphism into a tensor product $X\otimes Y$ factors as its marginal on3563$X$ followed by a morphism that produces $Y$ from $X$ and the input. In $\BorelStoch$ conditionals exist; this3564is the existence of regular conditional probabilities. A \term{Bayesian inverse} of $f\colon X\to Y$ with3565respect to a state $p$ is a morphism $f^\dagger\colon Y\to X$ with $(f\circ p)\rtimes f^\dagger$ equal to $p\rtimes f$ after3566exchanging the factors. Two morphisms $f,g\colon X\to Y$ are equal \term{$p$-almost surely} if3567$p\rtimes f=p\rtimes g$.3568 3569An infinite tensor product $\bigotimes_{i\in I}X_i$ is a \term{Kolmogorov product} if it is the limit of the finite3570tensor products with their marginalization maps, the limit is preserved by tensoring with any object, and3571the projections to finite subproducts are deterministic \cite{FR20}. In $\BorelStoch$ countable Kolmogorov3572products exist and are the usual product spaces.3573 3574For a category $D$ and a Markov category $\CC$, the functors $D\to\CC_{\det}$, with natural transformations whose3575components are arbitrary morphisms of $\CC$, form a Markov category \cite[\S7]{Fri20}. $\Dyn$ is the case in3576which $D$ is the group $\Z$ regarded as a category with one object.3577 3578\section{Operads}3579 3580A \term{symmetric operad} $P$ in a symmetric monoidal category consists of objects $P(n)$, $n\ge0$, of3581$n$-ary operations with actions of the symmetric groups, a unit in $P(1)$, and composition maps3582\[ P(m)\otimes P(k_1)\otimes\dots\otimes P(k_m)\longrightarrow P(k_1+\dots+k_m) \]3583that are associative, unital and equivariant. The \term{partial composite} $p\circ_iq$ inserts $q$ into the3584$i$-th input of $p$ and units into the others. The operad $\Delta$ of simplices has $\Delta(n)=\Delta_n$, the3585simplex of distributions on $n$ points, with the composition of \cref{ch:schemes}; it is an operad in3586topological spaces. Its algebras in sets or spaces are the convex spaces.3587 3588Given an operad $P$ in an additive setting and a bimodule $M$ over it, a \term{derivation} is a family of3589maps $d\colon P(n)\to M(n)$ with $d(p\circ_iq)=dp\circ_iq+p\circ_idq$. In \cref{thm:derivation} the bimodule is3590$\R$ in every arity, with $p\circ_ir=p_ir$ and $r\circ_iq=r$.3591 3592\section{Cohomology of a monoid}3593 3594Let $S$ be a monoid acting on an abelian group $F$. The complex of inhomogeneous cochains has3595$C^n=\{f\colon S^n\to F\}$ and coboundary3596\begin{align*}3597 (\delta f)(s_1,\dots,s_{n+1})={}&s_1.f(s_2,\dots,s_{n+1})+\sum_{k=1}^n(-1)^kf(\dots,s_ks_{k+1},\dots)\\3598 &+(-1)^{n+1}f(s_1,\dots,s_n).3599\end{align*}3600Its cohomology is $\Ext^\bullet_{\Z[S]}(\Z,F)$. A 1-cocycle is a \term{crossed homomorphism},3601$f(st)=f(s)+s.f(t)$, and a 1-coboundary has the form $f(s)=s.c-c$. The complex of \cref{def:complex} is the3602subcomplex of local cochains for the monoid of observables acting on functions of laws by conditioning. In3603the general setting of \cite{Vig20} the monoid varies over a poset and the computation is carried out for3604modules over a presheaf of algebras, in the topos of presheaves on that poset.3605 3606\section{Enrichment}3607 3608A category is \term{enriched} in a monoidal category $\mathcal{V}$ when its hom-sets are objects of3609$\mathcal{V}$ and composition is a morphism of $\mathcal{V}$. Three cases occur in the text.3610 3611\emph{Divergences.} A \term{divergence space} is a set $X$ with a function $D\colon X\times X\to[0,\infty]$ vanishing3612on the diagonal; a morphism is a map that does not increase $D$; the tensor product is the product of sets3613with the sum of the divergences. A category enriched in divergence spaces is one in which3614$D(g\circ f\,\|\,g'\circ f')\le D(f\,\|\,f')+D(g\,\|\,g')$. For a Markov category one asks in addition that the tensor3615product of morphisms be short \cite{Per24}. When $D$ is symmetric and satisfies the triangle inequality this3616is enrichment in metric spaces in the sense of Lawvere \cite{Law73}.3617 3618\emph{Topologies.} A category is enriched in topological spaces, with the canonical closed structure, when3619its hom-sets are spaces and composition is separately continuous. This is the enrichment used in3620\cite{PVB24}.3621 3622\emph{Orders.} A category enriched in posets has an order on each hom-set respected by composition. The3623order on idempotents in \cref{prop:idem} is of this kind.3624 3625\section{Dagger categories and idempotents}3626 3627A \term{dagger category} is a category with an involutive identity-on-objects functor3628$\dagger\colon\CC^{\op}\to\CC$. A morphism $e\colon X\to X$ is a \term{dagger idempotent} if $e\circ e=e=e^\dagger$. It3629\term{splits} if $e=i\circ i^\dagger$ with $i^\dagger\circ i=\id$; in $\Hilb$ the dagger idempotents are the orthogonal3630projections and all of them split. Dagger idempotents on an object are partially ordered by $e\le e'$ iff3631$e\circ e'=e$. The category $\Krn$ of \cref{def:krn} is a dagger category under Bayesian inversion, and3632$L^2\colon\Krn^{\op}\to\Hilb$ is a dagger functor.3633 3634\section{Preordered semirings}3635 3636A \term{preordered semiring} is a commutative semiring with a preorder such that $a\le b$ implies3637$a+c\le b+c$ and $ac\le bc$. The conditions under which \cref{thm:strassen} holds are stated before it. The3638asymptotic preorder is $a\lesssim b$ iff $a^n\le b^{n+o(n)}$; the theorem says that it is detected by the monotone3639homomorphisms to the nonnegative reals.3640%% ---- end ch/A-toolkit.tex ----3641%% ---- begin ch/B-concordance.tex ----3642\chapter{Concordance with Khinchin}\label{app:concordance}3643 3644The table lists the sections of the two papers in \cite{Khi57} and where their subject is treated here.3645Section numbers are those of the Dover edition. The correspondence is by topic; no passage of the source is3646reproduced.3647 3648\begin{center}\small