Independent scholarship · Open accessThe monthly digest

Indexed text attachment

algebraic-and-differential-topology-in-machine-learning-and-ai.tex

Source for Algebraic and Differential Topology in Machine Learning and AI: Obstructions, Invariants, and Counts

View paper · Download original file

Lines 321–420 of 1055. Source text is displayed literally.

321\draw[bwd,fill=white] (0.325,0.39) circle (2.1pt);322\draw[bwd,fill=white] (0.325,-0.39) circle (2.1pt);323\draw[bwd,fill=white] (1,-0.78) circle (2.1pt);324\draw[bwd,fill=white] (1.675,-0.39) circle (2.1pt);325\draw[bwd,fill=white] (1.675,0.39) circle (2.1pt);326\fill[accent] (1,0) circle (2.1pt);327\node[anchor=base] at (1,-1.2) {\scriptsize maximum};328\node[anchor=base] at (1,-1.52) {\scriptsize $0$ changes};329\node[anchor=base] at (1,-1.84) {\scriptsize index $1$};330\draw[ink2] (2.98,0.78)--(2.305,0.39)--(2.305,-0.39)--(2.98,-0.78)--(3.655,-0.39)--(3.655,0.39)--cycle;331\draw[ink2,very thin] (2.98,0)--(2.98,0.78);332\draw[ink2,very thin] (2.98,0)--(2.305,0.39);333\draw[ink2,very thin] (2.98,0)--(2.305,-0.39);334\draw[ink2,very thin] (2.98,0)--(2.98,-0.78);335\draw[ink2,very thin] (2.98,0)--(3.655,-0.39);336\draw[ink2,very thin] (2.98,0)--(3.655,0.39);337\fill[bwd] (2.98,0.78) circle (2.1pt);338\fill[bwd] (2.305,0.39) circle (2.1pt);339\fill[bwd] (2.305,-0.39) circle (2.1pt);340\draw[bwd,fill=white] (2.98,-0.78) circle (2.1pt);341\draw[bwd,fill=white] (3.655,-0.39) circle (2.1pt);342\draw[bwd,fill=white] (3.655,0.39) circle (2.1pt);343\fill[accent] (2.98,0) circle (2.1pt);344\node[anchor=base] at (2.98,-1.2) {\scriptsize regular};345\node[anchor=base] at (2.98,-1.52) {\scriptsize $2$ changes};346\node[anchor=base] at (2.98,-1.84) {\scriptsize index $0$};347\draw[ink2] (4.96,0.78)--(4.285,0.39)--(4.285,-0.39)--(4.96,-0.78)--(5.635,-0.39)--(5.635,0.39)--cycle;348\draw[ink2,very thin] (4.96,0)--(4.96,0.78);349\draw[ink2,very thin] (4.96,0)--(4.285,0.39);350\draw[ink2,very thin] (4.96,0)--(4.285,-0.39);351\draw[ink2,very thin] (4.96,0)--(4.96,-0.78);352\draw[ink2,very thin] (4.96,0)--(5.635,-0.39);353\draw[ink2,very thin] (4.96,0)--(5.635,0.39);354\fill[bwd] (4.96,0.78) circle (2.1pt);355\fill[bwd] (4.285,0.39) circle (2.1pt);356\draw[bwd,fill=white] (4.285,-0.39) circle (2.1pt);357\fill[bwd] (4.96,-0.78) circle (2.1pt);358\draw[bwd,fill=white] (5.635,-0.39) circle (2.1pt);359\draw[bwd,fill=white] (5.635,0.39) circle (2.1pt);360\fill[accent] (4.96,0) circle (2.1pt);361\node[anchor=base] at (4.96,-1.2) {\scriptsize saddle};362\node[anchor=base] at (4.96,-1.52) {\scriptsize $4$ changes};363\node[anchor=base] at (4.96,-1.84) {\scriptsize index $-1$};364\draw[ink2] (6.94,0.78)--(6.265,0.39)--(6.265,-0.39)--(6.94,-0.78)--(7.615,-0.39)--(7.615,0.39)--cycle;365\draw[ink2,very thin] (6.94,0)--(6.94,0.78);366\draw[ink2,very thin] (6.94,0)--(6.265,0.39);367\draw[ink2,very thin] (6.94,0)--(6.265,-0.39);368\draw[ink2,very thin] (6.94,0)--(6.94,-0.78);369\draw[ink2,very thin] (6.94,0)--(7.615,-0.39);370\draw[ink2,very thin] (6.94,0)--(7.615,0.39);371\fill[bwd] (6.94,0.78) circle (2.1pt);372\draw[bwd,fill=white] (6.265,0.39) circle (2.1pt);373\fill[bwd] (6.265,-0.39) circle (2.1pt);374\draw[bwd,fill=white] (6.94,-0.78) circle (2.1pt);375\fill[bwd] (7.615,-0.39) circle (2.1pt);376\draw[bwd,fill=white] (7.615,0.39) circle (2.1pt);377\fill[accent] (6.94,0) circle (2.1pt);378\node[anchor=base] at (6.94,-1.2) {\scriptsize monkey saddle};379\node[anchor=base] at (6.94,-1.52) {\scriptsize $6$ changes};380\node[anchor=base] at (6.94,-1.84) {\scriptsize index $-2$};381\end{tikzpicture}382\caption{The index of a vertex for a function on a mesh. Filled neighbours are higher than the centre, open ones lower; the index is one minus half the number of changes round the link. A minimum has the same link as a maximum with the marks exchanged, and index $1$.}\label{fig:index}383\end{figure}384 385\noindent The rule is drawn in \cref{fig:index}. The sums are $2,2,0,1,0$ for a tetrahedron, an icosahedron, the seven-vertex torus, the six-vertex386projective plane and a Klein bottle, for $100$ random functions each. \chk{O6} So a global frame field exists on a387closed orientable surface only when $\chi=0$, and on a sphere every choice of frames is singular with total388index $2$. This is the obstruction that gauge-equivariant convolution is designed around \cite{CWKW19}: since no389frame can be chosen, the layers must be equivariant for changes of frame.390 391In higher dimensions the same question has a sharp answer. A sphere $S^n$ with $n$ even has $\chi=2$ and not392even one tangent field without zeros; and $S^n$ has a global frame exactly for $n=1,3,7$, a theorem of the same393family as the Hopf invariant one problem \cite[Rem.~9.7]{ADTHC}. On $S^3$ the frame is explicit: at a unit394quaternion $q$ the vectors $qi$, $qj$, $qk$ are orthonormal and tangent. \chk{O11} This is why a latent space or395an output space that is a circle, a torus or the group of unit quaternions needs no gauge, and why constructions396that push a fixed noise distribution through the group multiplication are available there \cite{FdH18}, while397on $S^2$ they are not.398 399\subsection{Pieces and degree}400 401\begin{theorem}[Capacity for winding]\label{thm:pieces}402\Sob \emph{(a)} A continuous piecewise linear function of one variable with $k$ breakpoints is the sum of an403affine function and $k$ rectifier units. \emph{(b)} A closed piecewise linear curve in the punctured plane with $N$404segments has winding number of absolute value less than $N/2$. \emph{(c)} The polygon through the images of $N$405equally spaced points under $z\mapsto z^d$ winds $d'$ times, where $d'\equiv d\pmod N$ and $|d'|<N/2$.406\end{theorem}407\begin{proof}408(a) To the leftmost affine piece add one unit $c_i\relu(x-x_i)$ per breakpoint $x_i$, with $c_i$ the change of409slope. (b) A segment missing the410origin subtends an angle less than $\pi$. (c) Consecutive vertices differ by the angle $2\pi d/N$, taken in411$(-\pi,\pi)$.412\end{proof}413 414\begin{figure}[t]415\centering416\begin{tikzpicture}417\draw[ink2,thin] (1.9,0) circle (1.42);418\draw[fwd,thick,-{Stealth[length=4pt]}] (1.9,1.42)--(2.351,0.033);419\draw[fwd,thick] (2.351,0.033)--(2.735,-1.149);420\draw[fwd,thick,-{Stealth[length=4pt]}] (2.735,-1.149)--(1.555,-0.291);