Indexed text attachment
algebraic-and-differential-topology-in-machine-learning-and-ai.tex
Source for Algebraic and Differential Topology in Machine Learning and AI: Obstructions, Invariants, and Counts
View paper · Download original file
Lines 295–394 of 1055. Source text is displayed literally.
295\chk{O5} Statement (b) is the usable form: a data set of poses that contains a loop equivalent to a full turn has296no continuous quaternion labelling, whatever the convention; a data set confined to a ball of rotations has one.297A loss that identifies $q$ with $-q$ repairs the target but not the output layer, which still has to choose.298 299\subsection{Combing a mesh}300 301A convolution on a surface compares feature vectors at neighbouring points, which requires a frame at each point302in which to express them. A frame field is a framing in the sense of \cite[Ch.~8]{ADTHC}.303 304\begin{theorem}[Hairy ball, on meshes]\label{thm:hairy}305\Scl[Poincar\'e--Hopf; \cite{Ban67}] The zeros of a tangent vector field on a closed surface, counted with index,306number $\chi$. On a triangulated surface with a generic function $h$ on the vertices, define the index of a307vertex as $1-\frac12\#\{\text{sign changes of }h(w)-h(v)\text{ round the link}\}$; the indices add up to $\chi$.308\end{theorem}309 310\begin{figure}[t]311\centering312\begin{tikzpicture}313\draw[ink2] (1,0.78)--(0.325,0.39)--(0.325,-0.39)--(1,-0.78)--(1.675,-0.39)--(1.675,0.39)--cycle;314\draw[ink2,very thin] (1,0)--(1,0.78);315\draw[ink2,very thin] (1,0)--(0.325,0.39);316\draw[ink2,very thin] (1,0)--(0.325,-0.39);317\draw[ink2,very thin] (1,0)--(1,-0.78);318\draw[ink2,very thin] (1,0)--(1.675,-0.39);319\draw[ink2,very thin] (1,0)--(1.675,0.39);320\draw[bwd,fill=white] (1,0.78) circle (2.1pt);321\draw[bwd,fill=white] (0.325,0.39) circle (2.1pt);322\draw[bwd,fill=white] (0.325,-0.39) circle (2.1pt);323\draw[bwd,fill=white] (1,-0.78) circle (2.1pt);324\draw[bwd,fill=white] (1.675,-0.39) circle (2.1pt);325\draw[bwd,fill=white] (1.675,0.39) circle (2.1pt);326\fill[accent] (1,0) circle (2.1pt);327\node[anchor=base] at (1,-1.2) {\scriptsize maximum};328\node[anchor=base] at (1,-1.52) {\scriptsize $0$ changes};329\node[anchor=base] at (1,-1.84) {\scriptsize index $1$};330\draw[ink2] (2.98,0.78)--(2.305,0.39)--(2.305,-0.39)--(2.98,-0.78)--(3.655,-0.39)--(3.655,0.39)--cycle;331\draw[ink2,very thin] (2.98,0)--(2.98,0.78);332\draw[ink2,very thin] (2.98,0)--(2.305,0.39);333\draw[ink2,very thin] (2.98,0)--(2.305,-0.39);334\draw[ink2,very thin] (2.98,0)--(2.98,-0.78);335\draw[ink2,very thin] (2.98,0)--(3.655,-0.39);336\draw[ink2,very thin] (2.98,0)--(3.655,0.39);337\fill[bwd] (2.98,0.78) circle (2.1pt);338\fill[bwd] (2.305,0.39) circle (2.1pt);339\fill[bwd] (2.305,-0.39) circle (2.1pt);340\draw[bwd,fill=white] (2.98,-0.78) circle (2.1pt);341\draw[bwd,fill=white] (3.655,-0.39) circle (2.1pt);342\draw[bwd,fill=white] (3.655,0.39) circle (2.1pt);343\fill[accent] (2.98,0) circle (2.1pt);344\node[anchor=base] at (2.98,-1.2) {\scriptsize regular};345\node[anchor=base] at (2.98,-1.52) {\scriptsize $2$ changes};346\node[anchor=base] at (2.98,-1.84) {\scriptsize index $0$};347\draw[ink2] (4.96,0.78)--(4.285,0.39)--(4.285,-0.39)--(4.96,-0.78)--(5.635,-0.39)--(5.635,0.39)--cycle;348\draw[ink2,very thin] (4.96,0)--(4.96,0.78);349\draw[ink2,very thin] (4.96,0)--(4.285,0.39);350\draw[ink2,very thin] (4.96,0)--(4.285,-0.39);351\draw[ink2,very thin] (4.96,0)--(4.96,-0.78);352\draw[ink2,very thin] (4.96,0)--(5.635,-0.39);353\draw[ink2,very thin] (4.96,0)--(5.635,0.39);354\fill[bwd] (4.96,0.78) circle (2.1pt);355\fill[bwd] (4.285,0.39) circle (2.1pt);356\draw[bwd,fill=white] (4.285,-0.39) circle (2.1pt);357\fill[bwd] (4.96,-0.78) circle (2.1pt);358\draw[bwd,fill=white] (5.635,-0.39) circle (2.1pt);359\draw[bwd,fill=white] (5.635,0.39) circle (2.1pt);360\fill[accent] (4.96,0) circle (2.1pt);361\node[anchor=base] at (4.96,-1.2) {\scriptsize saddle};362\node[anchor=base] at (4.96,-1.52) {\scriptsize $4$ changes};363\node[anchor=base] at (4.96,-1.84) {\scriptsize index $-1$};364\draw[ink2] (6.94,0.78)--(6.265,0.39)--(6.265,-0.39)--(6.94,-0.78)--(7.615,-0.39)--(7.615,0.39)--cycle;365\draw[ink2,very thin] (6.94,0)--(6.94,0.78);366\draw[ink2,very thin] (6.94,0)--(6.265,0.39);367\draw[ink2,very thin] (6.94,0)--(6.265,-0.39);368\draw[ink2,very thin] (6.94,0)--(6.94,-0.78);369\draw[ink2,very thin] (6.94,0)--(7.615,-0.39);370\draw[ink2,very thin] (6.94,0)--(7.615,0.39);371\fill[bwd] (6.94,0.78) circle (2.1pt);372\draw[bwd,fill=white] (6.265,0.39) circle (2.1pt);373\fill[bwd] (6.265,-0.39) circle (2.1pt);374\draw[bwd,fill=white] (6.94,-0.78) circle (2.1pt);375\fill[bwd] (7.615,-0.39) circle (2.1pt);376\draw[bwd,fill=white] (7.615,0.39) circle (2.1pt);377\fill[accent] (6.94,0) circle (2.1pt);378\node[anchor=base] at (6.94,-1.2) {\scriptsize monkey saddle};379\node[anchor=base] at (6.94,-1.52) {\scriptsize $6$ changes};380\node[anchor=base] at (6.94,-1.84) {\scriptsize index $-2$};381\end{tikzpicture}382\caption{The index of a vertex for a function on a mesh. Filled neighbours are higher than the centre, open ones lower; the index is one minus half the number of changes round the link. A minimum has the same link as a maximum with the marks exchanged, and index $1$.}\label{fig:index}383\end{figure}384 385\noindent The rule is drawn in \cref{fig:index}. The sums are $2,2,0,1,0$ for a tetrahedron, an icosahedron, the seven-vertex torus, the six-vertex386projective plane and a Klein bottle, for $100$ random functions each. \chk{O6} So a global frame field exists on a387closed orientable surface only when $\chi=0$, and on a sphere every choice of frames is singular with total388index $2$. This is the obstruction that gauge-equivariant convolution is designed around \cite{CWKW19}: since no389frame can be chosen, the layers must be equivariant for changes of frame.390 391In higher dimensions the same question has a sharp answer. A sphere $S^n$ with $n$ even has $\chi=2$ and not392even one tangent field without zeros; and $S^n$ has a global frame exactly for $n=1,3,7$, a theorem of the same393family as the Hopf invariant one problem \cite[Rem.~9.7]{ADTHC}. On $S^3$ the frame is explicit: at a unit394quaternion $q$ the vectors $qi$, $qj$, $qk$ are orthonormal and tangent. \chk{O11} This is why a latent space or