Independent scholarship · Open accessThe monthly digest

Indexed text attachment

algebraic-and-differential-topology-in-machine-learning-and-ai.tex

Source for Algebraic and Differential Topology in Machine Learning and AI: Obstructions, Invariants, and Counts

View paper · Download original file

Lines 621–720 of 1055. Source text is displayed literally.

621\draw[ink2,very thin,fill=white] (1,2.1) rectangle (1.92,2.52);622\node at (1.46,-0.22) {\scriptsize $1$};623\draw[ink2,very thin,fill=fwd!22] (1.92,0) rectangle (2.84,0.42);624\node at (2.38,0.21) {\scriptsize $1$};625\draw[ink2,very thin,fill=fwd!22] (1.92,0.42) rectangle (2.84,0.84);626\node at (2.38,0.63) {\scriptsize $1$};627\draw[ink2,very thin,fill=white] (1.92,0.84) rectangle (2.84,1.26);628\draw[ink2,very thin,fill=white] (1.92,1.26) rectangle (2.84,1.68);629\draw[ink2,very thin,fill=white] (1.92,1.68) rectangle (2.84,2.1);630\draw[ink2,very thin,fill=white] (1.92,2.1) rectangle (2.84,2.52);631\node at (2.38,-0.22) {\scriptsize $2$};632\draw[ink2,very thin,fill=fwd!22] (2.84,0) rectangle (3.76,0.42);633\node at (3.3,0.21) {\scriptsize $1$};634\draw[ink2,very thin,fill=fwd!22] (2.84,0.42) rectangle (3.76,0.84);635\node at (3.3,0.63) {\scriptsize $1$};636\draw[ink2,very thin,fill=white] (2.84,0.84) rectangle (3.76,1.26);637\draw[ink2,very thin,fill=white] (2.84,1.26) rectangle (3.76,1.68);638\draw[ink2,very thin,fill=white] (2.84,1.68) rectangle (3.76,2.1);639\draw[ink2,very thin,fill=white] (2.84,2.1) rectangle (3.76,2.52);640\node at (3.3,-0.22) {\scriptsize $3$};641\draw[ink2,very thin,fill=fwd!22] (3.76,0) rectangle (4.68,0.42);642\node at (4.22,0.21) {\scriptsize $1$};643\draw[ink2,very thin,fill=white] (3.76,0.42) rectangle (4.68,0.84);644\draw[ink2,very thin,fill=accent!28] (3.76,0.84) rectangle (4.68,1.26);645\node at (4.22,1.05) {\scriptsize $3$};646\draw[ink2,very thin,fill=white] (3.76,1.26) rectangle (4.68,1.68);647\draw[ink2,very thin,fill=white] (3.76,1.68) rectangle (4.68,2.1);648\draw[ink2,very thin,fill=white] (3.76,2.1) rectangle (4.68,2.52);649\node at (4.22,-0.22) {\scriptsize $4$};650\draw[ink2,very thin,fill=fwd!22] (4.68,0) rectangle (5.6,0.42);651\node at (5.14,0.21) {\scriptsize $1$};652\draw[ink2,very thin,fill=white] (4.68,0.42) rectangle (5.6,0.84);653\draw[ink2,very thin,fill=white] (4.68,0.84) rectangle (5.6,1.26);654\draw[ink2,very thin,fill=white] (4.68,1.26) rectangle (5.6,1.68);655\draw[ink2,very thin,fill=white] (4.68,1.68) rectangle (5.6,2.1);656\draw[ink2,very thin,fill=accent!28] (4.68,2.1) rectangle (5.6,2.52);657\node at (5.14,2.31) {\scriptsize $1$};658\node at (5.14,-0.22) {\scriptsize $5$};659\draw[ink2,very thin,fill=fwd!22] (5.6,0) rectangle (6.52,0.42);660\node at (6.06,0.21) {\scriptsize $1$};661\draw[ink2,very thin,fill=white] (5.6,0.42) rectangle (6.52,0.84);662\draw[ink2,very thin,fill=white] (5.6,0.84) rectangle (6.52,1.26);663\draw[ink2,very thin,fill=white] (5.6,1.26) rectangle (6.52,1.68);664\draw[ink2,very thin,fill=white] (5.6,1.68) rectangle (6.52,2.1);665\draw[ink2,very thin,fill=white] (5.6,2.1) rectangle (6.52,2.52);666\node at (6.06,-0.22) {\scriptsize $6$};667\node[left,inner sep=2pt] at (1,0.21) {\scriptsize $H_0$};668\node[left,inner sep=2pt] at (1,0.63) {\scriptsize $H_1$};669\node[left,inner sep=2pt] at (1,1.05) {\scriptsize $H_2$};670\node[left,inner sep=2pt] at (1,1.47) {\scriptsize $H_3$};671\node[left,inner sep=2pt] at (1,1.89) {\scriptsize $H_4$};672\node[left,inner sep=2pt] at (1,2.31) {\scriptsize $H_5$};673\node at (3.76,-0.62) {\scriptsize scale $k$ (steps of $\frac1{12}$ of a turn)};674\draw[ink2] (1,3.04)--(6.06,3.04);675\draw[ink2] (4.22,2.97)--(4.22,3.11);676\draw[ink2] (4.956,2.97)--(4.956,3.11);677\draw[ink2] (5.271,2.97)--(5.271,3.11);678\draw[ink2] (6.06,2.97)--(6.06,3.11);679\node[above,inner sep=2pt] at (2.61,3.04) {\scriptsize $S^1$};680\node[above,inner sep=2pt] at (4.588,3.04) {\scriptsize $S^3$};681\node[above,inner sep=2pt] at (5.134,3.34) {\scriptsize $S^5$};682\draw[ink2,very thin] (5.114,3.06)--(5.134,3.34);683\node[above,inner sep=2pt] at (5.666,3.04) {\scriptsize $\cdots$};684\node[below,inner sep=2.5pt] at (4.22,3.02) {\tiny $\frac13$};685\node[below,inner sep=2.5pt] at (4.956,3.02) {\tiny $\frac25$};686\node[below,inner sep=2.5pt] at (6.06,3.02) {\tiny $\frac12$};687\node[right,inner sep=3pt] at (6.06,3.04) {\scriptsize circle};688\end{tikzpicture}689\caption{Betti numbers over $\Fp_2$ of the Vietoris--Rips complex of twelve equally spaced points on a circle, by scale. The class of the circle (blue) lasts up to $k=3$. At $k=4$, exactly a third of a turn, three classes appear in degree $2$, and at $k=5$ one in degree $5$ (red); at $k=6$ the complex is a full simplex. The line above shows the homotopy type of the complex of the whole circle at the corresponding scale \cite{AdAd17}.}\label{fig:barcode}690\end{figure}691 692\noindent For $n=12$ the Betti numbers over $\Fp_2$ are $(1,1)$ for $k=1,2,3$; $(1,0,3)$ for $k=4$; and693$(1,0,0,0,0,1)$ for $k=5$ (\cref{fig:barcode}). For $n=13$ and $k=5$, which lies between $\frac13$ and $\frac25$, they are $(1,0,0,1)$.694\chk{V4, V5} For $16$ random points on the unit circle whose largest gap is a chord of length $1.516$, the complex695has Betti numbers $(11,0)$ at $r=0.15$, $(1,1)$ at $r=1.55$ and $(1,0)$ at $r=1.9$. \chk{V6} The circle is seen from the largest gap up to about $\sqrt3$,696the chord of a third of a turn. Above that scale the classes in dimensions697$2$, $3$ and $5$ are topology of the construction and not of the data. A learned model that consumes persistence698diagrams should not treat high-dimensional classes at large scales as evidence of high-dimensional structure.699 700\subsection{Stability}701 702A \term{persistence diagram} records, for each homology class of the sublevel sets $\{f\le t\}$ of a function,703the levels at which it is born and dies. The \term{bottleneck distance} between two diagrams is the least704$\delta$ for which their points can be matched, to each other or to the diagonal, with no point moved by more705than $\delta$.706 707\begin{theorem}[Stability]\label{thm:stability}708\Scl[\cite{CEH07}] For two functions $f,g$ on a finite complex, the bottleneck distance between their persistence709diagrams is at most $\max|f-g|$.710\end{theorem}711 712\noindent For $60$ random functions on a cycle of $40$ vertices, perturbed by between $0.02$ and $0.3$ in the713maximum norm, the distance between the diagrams in degree $0$ was never larger than the perturbation, and714equal to it in the worst case, while the number of points of the diagram changed in $35$ of the $60$ cases.715\chk{V7} The diagram is a Lipschitz function of the data and a Betti number is not even continuous. This is the716property that lets persistence enter a model as a feature or a loss, and it is the quantitative form of the717functoriality of homology: a small change of $f$ is an interleaving of the two filtrations.718 719\section{Counts}\label{sec:counts}720