Indexed text attachment
algebraic-and-differential-topology-in-machine-learning-and-ai.tex
Source for Algebraic and Differential Topology in Machine Learning and AI: Obstructions, Invariants, and Counts
View paper · Download original file
Lines 781–880 of 1055. Source text is displayed literally.
781\draw[accent,thick,fill=white] (0.521,3.118) circle (2.1pt);782\draw[accent,thick,fill=white] (1.286,1.775) circle (2.1pt);783\draw[accent,thick,fill=white] (0.53,3.569) circle (2.1pt);784\draw[accent,thick,fill=white] (1.116,4.969) circle (2.1pt);785\draw[accent,thick,fill=white] (3.21,1.164) circle (2.1pt);786\draw[accent,thick,fill=white] (2.829,1.232) circle (2.1pt);787\draw[accent,thick,fill=white] (2.243,1.074) circle (2.1pt);788\draw[accent,thick,fill=white] (2.026,3.347) circle (2.1pt);789\draw[accent,thick,fill=white] (2.102,3.835) circle (2.1pt);790\draw[accent,thick,fill=white] (2.407,3.084) circle (2.1pt);791\draw[accent,thick,fill=white] (2.576,2.811) circle (2.1pt);792\draw[accent,thick,fill=white] (3.841,2.118) circle (2.1pt);793\draw[accent,thick,fill=white] (4.278,2.381) circle (2.1pt);794\draw[accent,thick,fill=white] (3.928,3.183) circle (2.1pt);795\draw[accent,thick,fill=white] (4.151,4.075) circle (2.1pt);796\draw[accent,thick,fill=white] (2.86,4.425) circle (2.1pt);797\end{tikzpicture}798\caption{A nearest-prototype classifier of the square with $14$ classes; the dots are the prototypes. No region reaches from one side to the opposite side, and there are $17$ points (circled) where three classes meet. By \cref{thm:junctions} at least one is forced, however the regions are drawn.}\label{fig:voronoi}799\end{figure}800 801For $60$ random nearest-prototype classifiers of the square with $14$ classes (one is drawn in802\cref{fig:voronoi}) there were between $13$ and $18$ triple points, and for $8$ classifiers of the cube with $40$ classes between $143$ and $174$ points803where four classes meet. \chk{N1, N2} The statement is a topological companion to results on the unavoidability of nearby misclassification804\cite{SHSFG19}: those use isoperimetric inequalities to estimate the measure of the points near a boundary, and805this one says that the boundaries themselves must meet, $n+1$ at a time. The proof is Sperner's806lemma, and the lemma comes with an algorithm: walk from cell to cell through faces carrying a fixed set of $n$807labels. For a labelling induced by a smooth self-map of the triangle the walk reaches a complete cell, and with808it an approximate fixed point, in $13$, $25$, $50$, $97$ steps on grids of side $16$, $32$, $64$, $128$, linear809in the side although the number of cells is quadratic. \chk{N3} In high dimension the walk can be exponentially810long, and finding its end is complete for the class PPAD \cite{Pap94,DGP09}; this is the complexity of computing811an equilibrium of a game, or a fixed point of an implicit layer \cite{BKK19}, without further structure.812 813\subsection{Fixed points of attractors}814 815Recurrent networks that hold a continuous variable do so on a manifold of fixed points: a ring for a heading, a816torus for a position \cite{BBS95,Zha96,GHP22}. A trained or perturbed network is a map of that manifold817close to the identity, or to another map of known degree.818 819\begin{theorem}[Lefschetz counts]\label{thm:lefcount}820\Scl[\cite{ADTHC}, Thm.~6.2, Prop.~6.3] \emph{(a)} A map of the circle of degree $d$ with non-degenerate fixed points821has fixed points of total index $1-d$; for $d=1$ their number is even, and for a map close to the identity half of them are stable. \emph{(b)} The zeros of822a vector field on a torus have total index $0$, and on a sphere $2$. \emph{(c)} A map of a closed manifold823homotopic to the identity has Lefschetz number $\chi$.824\end{theorem}825 826\begin{figure}[t]827\centering828\begin{tikzpicture}829\begin{scope}[shift={(0.6,0)}]830\draw[ink2] (0,0) rectangle (6.6,4.3);831\draw[ink2] (0,0)--(0,-0.07) node[below,inner sep=1.5pt]{\scriptsize $0$};832\draw[ink2] (3.3,0)--(3.3,-0.07) node[below,inner sep=1.5pt]{\scriptsize $\pi$};833\draw[ink2] (6.6,0)--(6.6,-0.07) node[below,inner sep=1.5pt]{\scriptsize $2\pi$};834\draw[ink2] (0,0.59)--(-0.07,0.59) node[left,inner sep=1.5pt]{\scriptsize $-2\pi$};835\draw[ink2] (0,2.073)--(-0.07,2.073) node[left,inner sep=1.5pt]{\scriptsize $0$};836\draw[ink2] (0,3.556)--(-0.07,3.556) node[left,inner sep=1.5pt]{\scriptsize $2\pi$};837\node[below] at (3.3,-0.38) {\scriptsize $\theta$};838\draw[ink2,densely dotted] (0,0.59)--(6.6,0.59);839\draw[ink2,densely dotted] (0,2.073)--(6.6,2.073);840\draw[ink2,densely dotted] (0,3.556)--(6.6,3.556);841\draw[thick,bwd] plot coordinates {(0,2.67) (0.022,2.656) (0.044,2.642) (0.066,2.628) (0.088,2.615) (0.11,2.603) (0.132,2.591) (0.154,2.58) (0.176,2.571) (0.198,2.562) (0.22,2.554) (0.242,2.547) (0.264,2.541) (0.286,2.536) (0.308,2.533) (0.33,2.53) (0.352,2.529) (0.374,2.528) (0.396,2.529) (0.418,2.53) (0.44,2.532) (0.462,2.536) (0.484,2.539) (0.506,2.544) (0.528,2.549) (0.55,2.554) (0.572,2.56) (0.594,2.565) (0.616,2.571) (0.638,2.577) (0.66,2.583) (0.682,2.588) (0.704,2.592) (0.726,2.596) (0.748,2.6) (0.77,2.602) (0.792,2.604) (0.814,2.604) (0.836,2.604) (0.858,2.602) (0.88,2.599) (0.902,2.594) (0.924,2.588) (0.946,2.58) (0.968,2.57) (0.99,2.559) (1.012,2.546) (1.034,2.532) (1.056,2.516) (1.078,2.498) (1.1,2.479) (1.122,2.458) (1.144,2.435) (1.166,2.411) (1.188,2.386) (1.21,2.359) (1.232,2.331) (1.254,2.302) (1.276,2.271) (1.298,2.24) (1.32,2.209) (1.342,2.176) (1.364,2.143) (1.386,2.11) (1.408,2.077) (1.43,2.043) (1.452,2.01) (1.474,1.977) (1.496,1.945) (1.518,1.913) (1.54,1.882) (1.562,1.852) (1.584,1.823) (1.606,1.795) (1.628,1.769) (1.65,1.744) (1.672,1.72) (1.694,1.698) (1.716,1.678) (1.738,1.66) (1.76,1.644) (1.782,1.629) (1.804,1.617) (1.826,1.607) (1.848,1.598) (1.87,1.592) (1.892,1.588) (1.914,1.585) (1.936,1.585) (1.958,1.587) (1.98,1.59) (2.002,1.595) (2.024,1.602) (2.046,1.61) (2.068,1.619) (2.09,1.63) (2.112,1.642) (2.134,1.655) (2.156,1.669) (2.178,1.683) (2.2,1.698) (2.222,1.713) (2.244,1.728) (2.266,1.743) (2.288,1.758) (2.31,1.773) (2.332,1.787) (2.354,1.8) (2.376,1.812) (2.398,1.823) (2.42,1.833) (2.442,1.842) (2.464,1.849) (2.486,1.854) (2.508,1.857) (2.53,1.859) (2.552,1.858) (2.574,1.856) (2.596,1.851) (2.618,1.845) (2.64,1.836) (2.662,1.824) (2.684,1.811) (2.706,1.795) (2.728,1.777) (2.75,1.757) (2.772,1.734) (2.794,1.71) (2.816,1.684) (2.838,1.656) (2.86,1.626) (2.882,1.594) (2.904,1.561) (2.926,1.527) (2.948,1.491) (2.97,1.455) (2.992,1.418) (3.014,1.38) (3.036,1.341) (3.058,1.303) (3.08,1.264) (3.102,1.226) (3.124,1.188) (3.146,1.15) (3.168,1.113) (3.19,1.078) (3.212,1.043) (3.234,1.01) (3.256,0.978) (3.278,0.948) (3.3,0.919) (3.322,0.893) (3.344,0.869) (3.366,0.847) (3.388,0.827) (3.41,0.809) (3.432,0.795) (3.454,0.782) (3.476,0.773) (3.498,0.765) (3.52,0.761) (3.542,0.759) (3.564,0.76) (3.586,0.763) (3.608,0.769) (3.63,0.777) (3.652,0.787) (3.674,0.8) (3.696,0.814) (3.718,0.831) (3.74,0.849) (3.762,0.869) (3.784,0.891) (3.806,0.913) (3.828,0.937) (3.85,0.962) (3.872,0.987) (3.894,1.013) (3.916,1.038) (3.938,1.064) (3.96,1.09) (3.982,1.115) (4.004,1.14) (4.026,1.163) (4.048,1.186) (4.07,1.207) (4.092,1.227) (4.114,1.245) (4.136,1.262) (4.158,1.276) (4.18,1.288) (4.202,1.298) (4.224,1.306) (4.246,1.31) (4.268,1.313) (4.29,1.312) (4.312,1.309) (4.334,1.303) (4.356,1.295) (4.378,1.283) (4.4,1.269) (4.422,1.252) (4.444,1.232) (4.466,1.209) (4.488,1.184) (4.51,1.157) (4.532,1.127) (4.554,1.095) (4.576,1.061) (4.598,1.026) (4.62,0.988) (4.642,0.949) (4.664,0.909) (4.686,0.867) (4.708,0.825) (4.73,0.782) (4.752,0.739) (4.774,0.695) (4.796,0.652) (4.818,0.609) (4.84,0.566) (4.862,0.524) (4.884,0.483) (4.906,0.444) (4.928,0.405) (4.95,0.369) (4.972,0.334) (4.994,0.302) (5.016,0.271) (5.038,0.243) (5.06,0.217) (5.082,0.195) (5.104,0.175) (5.126,0.157) (5.148,0.143) (5.17,0.132) (5.192,0.124) (5.214,0.12) (5.236,0.118) (5.258,0.12) (5.28,0.124) (5.302,0.132) (5.324,0.143) (5.346,0.158) (5.368,0.175) (5.39,0.194) (5.412,0.217) (5.434,0.242) (5.456,0.27) (5.478,0.3) (5.5,0.332) (5.522,0.365) (5.544,0.401) (5.566,0.438) (5.588,0.477) (5.61,0.517) (5.632,0.557) (5.654,0.599) (5.676,0.641) (5.698,0.683) (5.72,0.725) (5.742,0.767) (5.764,0.809) (5.786,0.85) (5.808,0.89) (5.83,0.93) (5.852,0.968) (5.874,1.005) (5.896,1.041) (5.918,1.075) (5.94,1.107) (5.962,1.138) (5.984,1.166) (6.006,1.193) (6.028,1.217) (6.05,1.239) (6.072,1.259) (6.094,1.277) (6.116,1.292) (6.138,1.305) (6.16,1.316) (6.182,1.325) (6.204,1.332) (6.226,1.336) (6.248,1.338) (6.27,1.338) (6.292,1.337) (6.314,1.334) (6.336,1.328) (6.358,1.322) (6.38,1.314) (6.402,1.305) (6.424,1.294) (6.446,1.283) (6.468,1.27) (6.49,1.257) (6.512,1.244) (6.534,1.23) (6.556,1.215) (6.578,1.201) (6.6,1.187)};842\fill[bwd] (4.827,0.59) circle (1.9pt);843\draw[bwd,fill=white] (5.649,0.59) circle (1.9pt);844\fill[bwd] (1.411,2.073) circle (1.9pt);845\draw[thick,fwd] plot coordinates {(0,2.67) (0.022,2.661) (0.044,2.652) (0.066,2.643) (0.088,2.635) (0.11,2.628) (0.132,2.621) (0.154,2.615) (0.176,2.61) (0.198,2.606) (0.22,2.603) (0.242,2.601) (0.264,2.6) (0.286,2.6) (0.308,2.602) (0.33,2.604) (0.352,2.608) (0.374,2.612) (0.396,2.618) (0.418,2.624) (0.44,2.631) (0.462,2.639) (0.484,2.648) (0.506,2.657) (0.528,2.667) (0.55,2.678) (0.572,2.688) (0.594,2.699) (0.616,2.71) (0.638,2.72) (0.66,2.731) (0.682,2.741) (0.704,2.751) (0.726,2.76) (0.748,2.768) (0.77,2.775) (0.792,2.782) (0.814,2.787) (0.836,2.792) (0.858,2.795) (0.88,2.796) (0.902,2.796) (0.924,2.795) (0.946,2.792) (0.968,2.788) (0.99,2.782) (1.012,2.774) (1.034,2.764) (1.056,2.753) (1.078,2.74) (1.1,2.726) (1.122,2.71) (1.144,2.692) (1.166,2.673) (1.188,2.653) (1.21,2.631) (1.232,2.608) (1.254,2.583) (1.276,2.558) (1.298,2.532) (1.32,2.505) (1.342,2.478) (1.364,2.45) (1.386,2.422) (1.408,2.393) (1.43,2.365) (1.452,2.337) (1.474,2.309) (1.496,2.281) (1.518,2.254) (1.54,2.228) (1.562,2.203) (1.584,2.179) (1.606,2.156) (1.628,2.135) (1.65,2.114) (1.672,2.096) (1.694,2.079) (1.716,2.064) (1.738,2.051) (1.76,2.039) (1.782,2.03) (1.804,2.022) (1.826,2.017) (1.848,2.014) (1.87,2.012) (1.892,2.013) (1.914,2.016) (1.936,2.02) (1.958,2.027) (1.98,2.035) (2.002,2.045) (2.024,2.056) (2.046,2.07) (2.068,2.084) (2.09,2.1) (2.112,2.117) (2.134,2.134) (2.156,2.153) (2.178,2.172) (2.2,2.192) (2.222,2.212) (2.244,2.232) (2.266,2.252) (2.288,2.272) (2.31,2.292) (2.332,2.311) (2.354,2.329) (2.376,2.346) (2.398,2.362) (2.42,2.377) (2.442,2.39) (2.464,2.402) (2.486,2.412) (2.508,2.421) (2.53,2.427) (2.552,2.432) (2.574,2.434) (2.596,2.435) (2.618,2.433) (2.64,2.429) (2.662,2.422) (2.684,2.414) (2.706,2.403) (2.728,2.39) (2.75,2.375) (2.772,2.357) (2.794,2.338) (2.816,2.317) (2.838,2.293) (2.86,2.268) (2.882,2.242) (2.904,2.214) (2.926,2.184) (2.948,2.154) (2.97,2.122) (2.992,2.09) (3.014,2.057) (3.036,2.024) (3.058,1.99) (3.08,1.956) (3.102,1.923) (3.124,1.89) (3.146,1.857) (3.168,1.825) (3.19,1.795) (3.212,1.765) (3.234,1.736) (3.256,1.71) (3.278,1.684) (3.3,1.661) (3.322,1.639) (3.344,1.62) (3.366,1.603) (3.388,1.588) (3.41,1.576) (3.432,1.566) (3.454,1.558) (3.476,1.554) (3.498,1.552) (3.52,1.552) (3.542,1.555) (3.564,1.561) (3.586,1.569) (3.608,1.579) (3.63,1.592) (3.652,1.608) (3.674,1.625) (3.696,1.645) (3.718,1.666) (3.74,1.69) (3.762,1.715) (3.784,1.741) (3.806,1.769) (3.828,1.797) (3.85,1.827) (3.872,1.857) (3.894,1.888) (3.916,1.918) (3.938,1.949) (3.96,1.98) (3.982,2.01) (4.004,2.04) (4.026,2.068) (4.048,2.096) (4.07,2.122) (4.092,2.147) (4.114,2.17) (4.136,2.191) (4.158,2.21) (4.18,2.228) (4.202,2.242) (4.224,2.255) (4.246,2.265) (4.268,2.272) (4.29,2.276) (4.312,2.278) (4.334,2.277) (4.356,2.273) (4.378,2.267) (4.4,2.258) (4.422,2.245) (4.444,2.231) (4.466,2.213) (4.488,2.193) (4.51,2.171) (4.532,2.146) (4.554,2.119) (4.576,2.09) (4.598,2.059) (4.62,2.026) (4.642,1.992) (4.664,1.957) (4.686,1.92) (4.708,1.883) (4.73,1.845) (4.752,1.807) (4.774,1.768) (4.796,1.73) (4.818,1.691) (4.84,1.654) (4.862,1.617) (4.884,1.581) (4.906,1.546) (4.928,1.513) (4.95,1.481) (4.972,1.452) (4.994,1.424) (5.016,1.398) (5.038,1.375) (5.06,1.355) (5.082,1.337) (5.104,1.322) (5.126,1.309) (5.148,1.3) (5.17,1.294) (5.192,1.291) (5.214,1.291) (5.236,1.295) (5.258,1.301) (5.28,1.311) (5.302,1.324) (5.324,1.34) (5.346,1.359) (5.368,1.381) (5.39,1.406) (5.412,1.433) (5.434,1.463) (5.456,1.496) (5.478,1.531) (5.5,1.568) (5.522,1.606) (5.544,1.647) (5.566,1.689) (5.588,1.733) (5.61,1.777) (5.632,1.823) (5.654,1.869) (5.676,1.916) (5.698,1.963) (5.72,2.01) (5.742,2.057) (5.764,2.104) (5.786,2.15) (5.808,2.195) (5.83,2.24) (5.852,2.283) (5.874,2.325) (5.896,2.366) (5.918,2.405) (5.94,2.442) (5.962,2.477) (5.984,2.511) (6.006,2.542) (6.028,2.572) (6.05,2.599) (6.072,2.624) (6.094,2.646) (6.116,2.667) (6.138,2.685) (6.16,2.701) (6.182,2.714) (6.204,2.726) (6.226,2.735) (6.248,2.742) (6.27,2.748) (6.292,2.751) (6.314,2.752) (6.336,2.752) (6.358,2.751) (6.38,2.748) (6.402,2.743) (6.424,2.738) (6.446,2.731) (6.468,2.724) (6.49,2.716) (6.512,2.707) (6.534,2.698) (6.556,2.689) (6.578,2.679) (6.6,2.67)};846\fill[fwd] (1.702,2.073) circle (1.9pt);847\draw[fwd,fill=white] (2.052,2.073) circle (1.9pt);848\fill[fwd] (3.004,2.073) circle (1.9pt);849\draw[fwd,fill=white] (4.03,2.073) circle (1.9pt);850\fill[fwd] (4.588,2.073) circle (1.9pt);851\draw[fwd,fill=white] (5.749,2.073) circle (1.9pt);852\draw[thick,accent] plot coordinates {(0,2.67) (0.022,2.665) (0.044,2.661) (0.066,2.658) (0.088,2.655) (0.11,2.652) (0.132,2.651) (0.154,2.65) (0.176,2.65) (0.198,2.651) (0.22,2.653) (0.242,2.656) (0.264,2.66) (0.286,2.665) (0.308,2.671) (0.33,2.678) (0.352,2.687) (0.374,2.696) (0.396,2.707) (0.418,2.718) (0.44,2.73) (0.462,2.743) (0.484,2.757) (0.506,2.771) (0.528,2.786) (0.55,2.801) (0.572,2.817) (0.594,2.832) (0.616,2.848) (0.638,2.864) (0.66,2.879) (0.682,2.894) (0.704,2.909) (0.726,2.923) (0.748,2.936) (0.77,2.948) (0.792,2.96) (0.814,2.97) (0.836,2.98) (0.858,2.987) (0.88,2.994) (0.902,2.999) (0.924,3.003) (0.946,3.005) (0.968,3.005) (0.99,3.004) (1.012,3.001) (1.034,2.997) (1.056,2.991) (1.078,2.983) (1.1,2.973) (1.122,2.962) (1.144,2.949) (1.166,2.935) (1.188,2.92) (1.21,2.903) (1.232,2.884) (1.254,2.865) (1.276,2.845) (1.298,2.824) (1.32,2.802) (1.342,2.779) (1.364,2.756) (1.386,2.733) (1.408,2.71) (1.43,2.686) (1.452,2.663) (1.474,2.64) (1.496,2.617) (1.518,2.595) (1.54,2.574) (1.562,2.554) (1.584,2.535) (1.606,2.517) (1.628,2.5) (1.65,2.485) (1.672,2.472) (1.694,2.46) (1.716,2.45) (1.738,2.441) (1.76,2.435) (1.782,2.43) (1.804,2.428) (1.826,2.427) (1.848,2.429) (1.87,2.433) (1.892,2.438) (1.914,2.446) (1.936,2.455) (1.958,2.467) (1.98,2.48) (2.002,2.495) (2.024,2.511) (2.046,2.529) (2.068,2.549) (2.09,2.569) (2.112,2.591) (2.134,2.614) (2.156,2.638) (2.178,2.662) (2.2,2.687) (2.222,2.712) (2.244,2.737) (2.266,2.762) (2.288,2.787) (2.31,2.811) (2.332,2.835) (2.354,2.858) (2.376,2.88) (2.398,2.901) (2.42,2.921) (2.442,2.939) (2.464,2.956) (2.486,2.971) (2.508,2.985) (2.53,2.996) (2.552,3.005) (2.574,3.013) (2.596,3.018) (2.618,3.021) (2.64,3.022) (2.662,3.021) (2.684,3.017) (2.706,3.011) (2.728,3.003) (2.75,2.993) (2.772,2.98) (2.794,2.966) (2.816,2.949) (2.838,2.931) (2.86,2.911) (2.882,2.889) (2.904,2.866) (2.926,2.842) (2.948,2.816) (2.97,2.79) (2.992,2.762) (3.014,2.734) (3.036,2.706) (3.058,2.677) (3.08,2.649) (3.102,2.62) (3.124,2.592) (3.146,2.564) (3.168,2.537) (3.19,2.511) (3.212,2.487) (3.234,2.463) (3.256,2.441) (3.278,2.421) (3.3,2.402) (3.322,2.386) (3.344,2.372) (3.366,2.359) (3.388,2.35) (3.41,2.342) (3.432,2.337) (3.454,2.335) (3.476,2.335) (3.498,2.338) (3.52,2.343) (3.542,2.351) (3.564,2.362) (3.586,2.375) (3.608,2.39) (3.63,2.408) (3.652,2.428) (3.674,2.451) (3.696,2.475) (3.718,2.502) (3.74,2.53) (3.762,2.56) (3.784,2.591) (3.806,2.624) (3.828,2.658) (3.85,2.692) (3.872,2.727) (3.894,2.763) (3.916,2.799) (3.938,2.834) (3.96,2.87) (3.982,2.905) (4.004,2.939) (4.026,2.973) (4.048,3.005) (4.07,3.037) (4.092,3.066) (4.114,3.094) (4.136,3.121) (4.158,3.145) (4.18,3.167) (4.202,3.187) (4.224,3.204) (4.246,3.219) (4.268,3.231) (4.29,3.241) (4.312,3.247) (4.334,3.251) (4.356,3.252) (4.378,3.251) (4.4,3.246) (4.422,3.239) (4.444,3.229) (4.466,3.217) (4.488,3.202) (4.51,3.184) (4.532,3.164) (4.554,3.142) (4.576,3.118) (4.598,3.092) (4.62,3.065) (4.642,3.035) (4.664,3.005) (4.686,2.973) (4.708,2.941) (4.73,2.908) (4.752,2.875) (4.774,2.841) (4.796,2.807) (4.818,2.774) (4.84,2.741) (4.862,2.709) (4.884,2.679) (4.906,2.649) (4.928,2.62) (4.95,2.594) (4.972,2.569) (4.994,2.546) (5.016,2.526) (5.038,2.507) (5.06,2.492) (5.082,2.479) (5.104,2.469) (5.126,2.461) (5.148,2.457) (5.17,2.456) (5.192,2.458) (5.214,2.463) (5.236,2.471) (5.258,2.483) (5.28,2.498) (5.302,2.515) (5.324,2.536) (5.346,2.56) (5.368,2.587) (5.39,2.617) (5.412,2.649) (5.434,2.684) (5.456,2.722) (5.478,2.762) (5.5,2.804) (5.522,2.847) (5.544,2.893) (5.566,2.94) (5.588,2.989) (5.61,3.038) (5.632,3.089) (5.654,3.14) (5.676,3.192) (5.698,3.244) (5.72,3.296) (5.742,3.348) (5.764,3.399) (5.786,3.45) (5.808,3.501) (5.83,3.55) (5.852,3.598) (5.874,3.645) (5.896,3.691) (5.918,3.735) (5.94,3.777) (5.962,3.817) (5.984,3.856) (6.006,3.892) (6.028,3.926) (6.05,3.958) (6.072,3.988) (6.094,4.016) (6.116,4.041) (6.138,4.064) (6.16,4.085) (6.182,4.104) (6.204,4.12) (6.226,4.134) (6.248,4.146) (6.27,4.157) (6.292,4.165) (6.314,4.171) (6.336,4.176) (6.358,4.18) (6.38,4.181) (6.402,4.182) (6.424,4.181) (6.446,4.18) (6.468,4.177) (6.49,4.174) (6.512,4.17) (6.534,4.166) (6.556,4.162) (6.578,4.157) (6.6,4.153)};853\draw[accent,fill=white] (5.833,3.556) circle (1.9pt);854\node[bwd,anchor=west,inner sep=2pt] at (6.6,1.187) {\scriptsize $d=0$};855\node[fwd,anchor=west,inner sep=2pt] at (6.6,2.67) {\scriptsize $d=1$};856\node[accent,anchor=west,inner sep=2pt] at (6.6,4.153) {\scriptsize $d=2$};857\end{scope}858\end{tikzpicture}859\caption{Fixed points of three maps $\theta\mapsto d\theta+\epsilon g(\theta)$ of the circle, with the same $g$. Plotted is the displacement $(d-1)\theta+\epsilon g(\theta)$; a fixed point is a crossing of a multiple of $2\pi$ (dotted). Downward crossings have index $1$ (filled) and upward ones index $-1$ (open). The curve for $d$ climbs by $d-1$ levels in one turn, so the indices add up to $1-d$: here $3$, $6$, $1$ points with sums $1$, $0$, $-1$ for $d=0,1,2$.}\label{fig:circlemap}860\end{figure}861 862\noindent For circle maps $\theta\mapsto d\theta+\epsilon g(\theta)$ with random $g$ and $\epsilon=2$, the fixed863points number $5,7,6,9,8$ for $d=-2,0,1,2,3$ and their indices add up to $3,1,0,-1,-2$ (\cref{fig:circlemap}864shows three maps of the same kind). \chk{N4} For three drift865fields on a torus there are four zeros each, a source, a sink and two saddles. \chk{N5} The consequences differ866by manifold. On a ring or a torus, noise in the weights breaks the continuum of fixed points into isolated ones,867stable and unstable in balance, or removes all of them and leaves a uniform drift, which $\chi=0$ permits. On a868sphere that second outcome is impossible: every perturbation of a spherical attractor keeps a fixed point,869because $\chi=2$.870 871\subsection{Degree and the passage through zero}872 873Let a network produce $u_w(\theta)\in\R^2$ for an input on a circle and output the direction $u_w/|u_w|$. As long874as $u_w$ does not vanish this is a map of the circle to itself with a degree.875 876\begin{theorem}\label{thm:zero}877\Scl[\cite{ADTHC}, Thm.~9.1] \emph{(a)} The degree is the signed number of preimages of any regular direction.878\emph{(b)} Along a path of weights the degree is constant unless $u_w(\theta)=0$ for some $\theta$ and some879weight on the path.880\end{theorem}