Independent scholarship · Open accessThe monthly digest

Indexed text attachment

entropy-sources-and-channels-in-higher-categories.tex

Source for Entropy, Sources, and Channels in Higher Categories

View paper · Download original file

Lines 121–220 of 4249. Source text is displayed literally.

121\newcommand{\E}{\mathbb{E}}122\newcommand{\Prob}{\mathbb{P}}123\DeclareMathOperator*{\argmax}{arg\,max}124\DeclareMathOperator*{\colim}{colim}125\DeclareMathOperator{\Hom}{Hom}126\DeclareMathOperator{\Ext}{Ext}127\DeclareMathOperator{\Fix}{Fix}128\DeclareMathOperator{\supp}{supp}129\DeclareMathOperator{\TV}{TV}130\DeclareMathOperator{\rk}{rk}131\newcommand{\id}{\mathrm{id}}132\newcommand{\op}{\mathrm{op}}133\newcommand{\adj}{\dashv}134\newcommand{\iso}{\cong}135\newcommand{\st}{\mid}136\newcommand{\cpy}{\mathrm{copy}}137\newcommand{\del}{\mathrm{del}}138\newcommand{\KL}[2]{D(#1\,\|\,#2)}139\newcommand{\hb}{h}140\newcommand{\AZ}{A^{\Z}}141\newcommand{\BZ}{B^{\Z}}142\newcommand{\term}[1]{\textbf{\itshape #1}}143 144% ---------- tikz styles ----------145\tikzset{146  ogbox/.style={draw, thick, rounded corners=2pt, minimum width=1.25cm, minimum height=1.05cm, fill=black!4},147  fw/.style={-{Stealth[length=5pt]}, thick, fwd},148  bw/.style={-{Stealth[length=5pt]}, thick, bwd, densely dashed},149  dec/.style={circle, fill, inner sep=1.7pt},150  nat/.style={circle, draw, thick, fill=white, inner sep=1.7pt},151  leaf/.style={inner sep=2pt, font=\small},152  lab/.style={font=\small, inner sep=1.5pt},153  infoset/.style={densely dashed, thick, accent},154  st/.style={circle, draw, thick, fill=white, inner sep=1.6pt},155  ty/.style={rectangle, draw, thick, fill=black!8, inner sep=2.6pt},156}157\newcommand{\sol}[1]{\par\medskip\noindent\textbf{#1.}\enspace\ignorespaces}158\newcommand{\bookauthor}{Anonymous}159%% ---- end preamble.tex ----160\begin{document}161\frontmatter162%% ---- begin front.tex ----163\begin{titlepage}164\thispagestyle{empty}165\vspace*{1.1in}166\noindent{\Large\scshape\color{accent} Higher Categorical Semantics}\par167\vspace{0.9in}168\noindent{\fontsize{30}{38}\selectfont\bfseries\raggedright Entropy, Sources,\\ and Channels\\ in Higher Categories\par}169\vspace{0.35in}170\noindent{\Large\itshape Cocycles, Markov categories, and coding\\[2pt] in the mathematical foundations of information theory}\par171\vfill172\noindent\begin{tikzpicture}[x=1cm,y=1cm]173  \node[ogbox] (mu) at (0,0) {$\mu$};174  \node[dec] (c) at (1.6,0) {};175  \node[ogbox] (nu) at (3.4,-0.65) {$\nu$};176  \draw[fw] (mu) -- (c);177  \draw[fw] (c) |- (5.4,0.65) node[right,lab,black]{$\AZ$};178  \draw[fw] (c) |- (nu);179  \draw[fw] (nu) -- (5.4,-0.65) node[right,lab,black]{$\BZ$};180\end{tikzpicture}\par181\vspace{0.5in}182\noindent{\large \bookauthor}\par183\vspace{4pt}184\noindent{\small 2026}185\end{titlepage}186 187\thispagestyle{empty}188\vspace*{\fill}189{\small190\noindent\textbf{About this text.}191This monograph is a higher-categorical treatment of the territory mapped by A.~I.~Khinchin's192\emph{Mathematical Foundations of Information Theory} (Dover, 1957; the English translation, by R.~A.~Silverman and193M.~D.~Friedman, of two papers of 1953 and 1956): the entropy of finite schemes and its uniqueness, stationary194and ergodic sources, McMillan's theorem, channels with memory, Feinstein's lemma, and Shannon's coding195theorems. It is an independent work. It reproduces none of that book's text or proofs verbatim; it is not196affiliated with or endorsed by its publisher. \Cref{app:concordance} gives a concordance so that the two can197be read side by side.198 199\medskip200\noindent\textbf{Status of results.}201Every numbered statement carries a tag: \textsf{classical} (standard information theory, probability or202ergodic theory, attributed), \textsf{literature} (established in the categorical or homological literature,203attributed), \textsf{reformulation} (a known result restated in a different language, with the restatement204proved or sketched here), \textsf{observation} (an elementary remark we have not found stated in this form),205or \textsf{programme} (a conjecture or a direction, not a result). No cited theorem is claimed as new.206 207\medskip208\noindent\textbf{Authorship and assistance.}209The text was drafted and typeset with a large language model (Anthropic's Claude) under the direction of210the submitting author, who is responsible for it. Generative AI assisted with drafting, literature recall,211mathematical consistency checks, computation, and typesetting. The numerical examples and a number of finite212structural claims are recomputed by the accompanying script \texttt{verify.py} (\cref{app:computations}).213Proofs and bibliographic details have not been independently refereed; corrections are welcome.214 215\medskip216\noindent Open access. Rights remain with the author.217}218\clearpage219 220\tableofcontents