Indexed text attachment
algebraic-and-differential-topology-in-machine-learning-and-ai.tex
Source for Algebraic and Differential Topology in Machine Learning and AI: Obstructions, Invariants, and Counts
View paper · Download original file
Lines 795–894 of 1055. Source text is displayed literally.
795\draw[accent,thick,fill=white] (4.151,4.075) circle (2.1pt);796\draw[accent,thick,fill=white] (2.86,4.425) circle (2.1pt);797\end{tikzpicture}798\caption{A nearest-prototype classifier of the square with $14$ classes; the dots are the prototypes. No region reaches from one side to the opposite side, and there are $17$ points (circled) where three classes meet. By \cref{thm:junctions} at least one is forced, however the regions are drawn.}\label{fig:voronoi}799\end{figure}800 801For $60$ random nearest-prototype classifiers of the square with $14$ classes (one is drawn in802\cref{fig:voronoi}) there were between $13$ and $18$ triple points, and for $8$ classifiers of the cube with $40$ classes between $143$ and $174$ points803where four classes meet. \chk{N1, N2} The statement is a topological companion to results on the unavoidability of nearby misclassification804\cite{SHSFG19}: those use isoperimetric inequalities to estimate the measure of the points near a boundary, and805this one says that the boundaries themselves must meet, $n+1$ at a time. The proof is Sperner's806lemma, and the lemma comes with an algorithm: walk from cell to cell through faces carrying a fixed set of $n$807labels. For a labelling induced by a smooth self-map of the triangle the walk reaches a complete cell, and with808it an approximate fixed point, in $13$, $25$, $50$, $97$ steps on grids of side $16$, $32$, $64$, $128$, linear809in the side although the number of cells is quadratic. \chk{N3} In high dimension the walk can be exponentially810long, and finding its end is complete for the class PPAD \cite{Pap94,DGP09}; this is the complexity of computing811an equilibrium of a game, or a fixed point of an implicit layer \cite{BKK19}, without further structure.812 813\subsection{Fixed points of attractors}814 815Recurrent networks that hold a continuous variable do so on a manifold of fixed points: a ring for a heading, a816torus for a position \cite{BBS95,Zha96,GHP22}. A trained or perturbed network is a map of that manifold817close to the identity, or to another map of known degree.818 819\begin{theorem}[Lefschetz counts]\label{thm:lefcount}820\Scl[\cite{ADTHC}, Thm.~6.2, Prop.~6.3] \emph{(a)} A map of the circle of degree $d$ with non-degenerate fixed points821has fixed points of total index $1-d$; for $d=1$ their number is even, and for a map close to the identity half of them are stable. \emph{(b)} The zeros of822a vector field on a torus have total index $0$, and on a sphere $2$. \emph{(c)} A map of a closed manifold823homotopic to the identity has Lefschetz number $\chi$.824\end{theorem}825 826\begin{figure}[t]827\centering828\begin{tikzpicture}829\begin{scope}[shift={(0.6,0)}]830\draw[ink2] (0,0) rectangle (6.6,4.3);831\draw[ink2] (0,0)--(0,-0.07) node[below,inner sep=1.5pt]{\scriptsize $0$};832\draw[ink2] (3.3,0)--(3.3,-0.07) node[below,inner sep=1.5pt]{\scriptsize $\pi$};833\draw[ink2] (6.6,0)--(6.6,-0.07) node[below,inner sep=1.5pt]{\scriptsize $2\pi$};834\draw[ink2] (0,0.59)--(-0.07,0.59) node[left,inner sep=1.5pt]{\scriptsize $-2\pi$};835\draw[ink2] (0,2.073)--(-0.07,2.073) node[left,inner sep=1.5pt]{\scriptsize $0$};836\draw[ink2] (0,3.556)--(-0.07,3.556) node[left,inner sep=1.5pt]{\scriptsize $2\pi$};837\node[below] at (3.3,-0.38) {\scriptsize $\theta$};838\draw[ink2,densely dotted] (0,0.59)--(6.6,0.59);839\draw[ink2,densely dotted] (0,2.073)--(6.6,2.073);840\draw[ink2,densely dotted] (0,3.556)--(6.6,3.556);841\draw[thick,bwd] plot coordinates {(0,2.67) (0.022,2.656) (0.044,2.642) (0.066,2.628) (0.088,2.615) (0.11,2.603) (0.132,2.591) (0.154,2.58) (0.176,2.571) (0.198,2.562) (0.22,2.554) (0.242,2.547) (0.264,2.541) (0.286,2.536) (0.308,2.533) (0.33,2.53) (0.352,2.529) (0.374,2.528) (0.396,2.529) (0.418,2.53) (0.44,2.532) (0.462,2.536) (0.484,2.539) (0.506,2.544) (0.528,2.549) (0.55,2.554) (0.572,2.56) (0.594,2.565) (0.616,2.571) (0.638,2.577) (0.66,2.583) (0.682,2.588) (0.704,2.592) (0.726,2.596) (0.748,2.6) (0.77,2.602) (0.792,2.604) (0.814,2.604) (0.836,2.604) (0.858,2.602) (0.88,2.599) (0.902,2.594) (0.924,2.588) (0.946,2.58) (0.968,2.57) (0.99,2.559) (1.012,2.546) (1.034,2.532) (1.056,2.516) (1.078,2.498) (1.1,2.479) (1.122,2.458) (1.144,2.435) (1.166,2.411) (1.188,2.386) (1.21,2.359) (1.232,2.331) (1.254,2.302) (1.276,2.271) (1.298,2.24) (1.32,2.209) (1.342,2.176) (1.364,2.143) (1.386,2.11) (1.408,2.077) (1.43,2.043) (1.452,2.01) (1.474,1.977) (1.496,1.945) (1.518,1.913) (1.54,1.882) (1.562,1.852) (1.584,1.823) (1.606,1.795) (1.628,1.769) (1.65,1.744) (1.672,1.72) (1.694,1.698) (1.716,1.678) (1.738,1.66) (1.76,1.644) (1.782,1.629) (1.804,1.617) (1.826,1.607) (1.848,1.598) (1.87,1.592) (1.892,1.588) (1.914,1.585) (1.936,1.585) (1.958,1.587) (1.98,1.59) (2.002,1.595) (2.024,1.602) (2.046,1.61) (2.068,1.619) (2.09,1.63) (2.112,1.642) (2.134,1.655) (2.156,1.669) (2.178,1.683) (2.2,1.698) (2.222,1.713) (2.244,1.728) (2.266,1.743) (2.288,1.758) (2.31,1.773) (2.332,1.787) (2.354,1.8) (2.376,1.812) (2.398,1.823) (2.42,1.833) (2.442,1.842) (2.464,1.849) (2.486,1.854) (2.508,1.857) (2.53,1.859) (2.552,1.858) (2.574,1.856) (2.596,1.851) (2.618,1.845) (2.64,1.836) (2.662,1.824) (2.684,1.811) (2.706,1.795) (2.728,1.777) (2.75,1.757) (2.772,1.734) (2.794,1.71) (2.816,1.684) (2.838,1.656) (2.86,1.626) (2.882,1.594) (2.904,1.561) (2.926,1.527) (2.948,1.491) (2.97,1.455) (2.992,1.418) (3.014,1.38) (3.036,1.341) (3.058,1.303) (3.08,1.264) (3.102,1.226) (3.124,1.188) (3.146,1.15) (3.168,1.113) (3.19,1.078) (3.212,1.043) (3.234,1.01) (3.256,0.978) (3.278,0.948) (3.3,0.919) (3.322,0.893) (3.344,0.869) (3.366,0.847) (3.388,0.827) (3.41,0.809) (3.432,0.795) (3.454,0.782) (3.476,0.773) (3.498,0.765) (3.52,0.761) (3.542,0.759) (3.564,0.76) (3.586,0.763) (3.608,0.769) (3.63,0.777) (3.652,0.787) (3.674,0.8) (3.696,0.814) (3.718,0.831) (3.74,0.849) (3.762,0.869) (3.784,0.891) (3.806,0.913) (3.828,0.937) (3.85,0.962) (3.872,0.987) (3.894,1.013) (3.916,1.038) (3.938,1.064) (3.96,1.09) (3.982,1.115) (4.004,1.14) (4.026,1.163) (4.048,1.186) (4.07,1.207) (4.092,1.227) (4.114,1.245) (4.136,1.262) (4.158,1.276) (4.18,1.288) (4.202,1.298) (4.224,1.306) (4.246,1.31) (4.268,1.313) (4.29,1.312) (4.312,1.309) (4.334,1.303) (4.356,1.295) (4.378,1.283) (4.4,1.269) (4.422,1.252) (4.444,1.232) (4.466,1.209) (4.488,1.184) (4.51,1.157) (4.532,1.127) (4.554,1.095) (4.576,1.061) (4.598,1.026) (4.62,0.988) (4.642,0.949) (4.664,0.909) (4.686,0.867) (4.708,0.825) (4.73,0.782) (4.752,0.739) (4.774,0.695) (4.796,0.652) (4.818,0.609) (4.84,0.566) (4.862,0.524) (4.884,0.483) (4.906,0.444) (4.928,0.405) (4.95,0.369) (4.972,0.334) (4.994,0.302) (5.016,0.271) (5.038,0.243) (5.06,0.217) (5.082,0.195) (5.104,0.175) (5.126,0.157) (5.148,0.143) (5.17,0.132) (5.192,0.124) (5.214,0.12) (5.236,0.118) (5.258,0.12) (5.28,0.124) (5.302,0.132) (5.324,0.143) (5.346,0.158) (5.368,0.175) (5.39,0.194) (5.412,0.217) (5.434,0.242) (5.456,0.27) (5.478,0.3) (5.5,0.332) (5.522,0.365) (5.544,0.401) (5.566,0.438) (5.588,0.477) (5.61,0.517) (5.632,0.557) (5.654,0.599) (5.676,0.641) (5.698,0.683) (5.72,0.725) (5.742,0.767) (5.764,0.809) (5.786,0.85) (5.808,0.89) (5.83,0.93) (5.852,0.968) (5.874,1.005) (5.896,1.041) (5.918,1.075) (5.94,1.107) (5.962,1.138) (5.984,1.166) (6.006,1.193) (6.028,1.217) (6.05,1.239) (6.072,1.259) (6.094,1.277) (6.116,1.292) (6.138,1.305) (6.16,1.316) (6.182,1.325) (6.204,1.332) (6.226,1.336) (6.248,1.338) (6.27,1.338) (6.292,1.337) (6.314,1.334) (6.336,1.328) (6.358,1.322) (6.38,1.314) (6.402,1.305) (6.424,1.294) (6.446,1.283) (6.468,1.27) (6.49,1.257) (6.512,1.244) (6.534,1.23) (6.556,1.215) (6.578,1.201) (6.6,1.187)};842\fill[bwd] (4.827,0.59) circle (1.9pt);843\draw[bwd,fill=white] (5.649,0.59) circle (1.9pt);844\fill[bwd] (1.411,2.073) circle (1.9pt);845\draw[thick,fwd] plot coordinates {(0,2.67) (0.022,2.661) (0.044,2.652) (0.066,2.643) (0.088,2.635) (0.11,2.628) (0.132,2.621) (0.154,2.615) (0.176,2.61) (0.198,2.606) (0.22,2.603) (0.242,2.601) (0.264,2.6) (0.286,2.6) (0.308,2.602) (0.33,2.604) (0.352,2.608) (0.374,2.612) (0.396,2.618) (0.418,2.624) (0.44,2.631) (0.462,2.639) (0.484,2.648) (0.506,2.657) (0.528,2.667) (0.55,2.678) (0.572,2.688) (0.594,2.699) (0.616,2.71) (0.638,2.72) (0.66,2.731) (0.682,2.741) (0.704,2.751) (0.726,2.76) (0.748,2.768) (0.77,2.775) (0.792,2.782) (0.814,2.787) (0.836,2.792) (0.858,2.795) (0.88,2.796) (0.902,2.796) (0.924,2.795) (0.946,2.792) (0.968,2.788) (0.99,2.782) (1.012,2.774) (1.034,2.764) (1.056,2.753) (1.078,2.74) (1.1,2.726) (1.122,2.71) (1.144,2.692) (1.166,2.673) (1.188,2.653) (1.21,2.631) (1.232,2.608) (1.254,2.583) (1.276,2.558) (1.298,2.532) (1.32,2.505) (1.342,2.478) (1.364,2.45) (1.386,2.422) (1.408,2.393) (1.43,2.365) (1.452,2.337) (1.474,2.309) (1.496,2.281) (1.518,2.254) (1.54,2.228) (1.562,2.203) (1.584,2.179) (1.606,2.156) (1.628,2.135) (1.65,2.114) (1.672,2.096) (1.694,2.079) (1.716,2.064) (1.738,2.051) (1.76,2.039) (1.782,2.03) (1.804,2.022) (1.826,2.017) (1.848,2.014) (1.87,2.012) (1.892,2.013) (1.914,2.016) (1.936,2.02) (1.958,2.027) (1.98,2.035) (2.002,2.045) (2.024,2.056) (2.046,2.07) (2.068,2.084) (2.09,2.1) (2.112,2.117) (2.134,2.134) (2.156,2.153) (2.178,2.172) (2.2,2.192) (2.222,2.212) (2.244,2.232) (2.266,2.252) (2.288,2.272) (2.31,2.292) (2.332,2.311) (2.354,2.329) (2.376,2.346) (2.398,2.362) (2.42,2.377) (2.442,2.39) (2.464,2.402) (2.486,2.412) (2.508,2.421) (2.53,2.427) (2.552,2.432) (2.574,2.434) (2.596,2.435) (2.618,2.433) (2.64,2.429) (2.662,2.422) (2.684,2.414) (2.706,2.403) (2.728,2.39) (2.75,2.375) (2.772,2.357) (2.794,2.338) (2.816,2.317) (2.838,2.293) (2.86,2.268) (2.882,2.242) (2.904,2.214) (2.926,2.184) (2.948,2.154) (2.97,2.122) (2.992,2.09) (3.014,2.057) (3.036,2.024) (3.058,1.99) (3.08,1.956) (3.102,1.923) (3.124,1.89) (3.146,1.857) (3.168,1.825) (3.19,1.795) (3.212,1.765) (3.234,1.736) (3.256,1.71) (3.278,1.684) (3.3,1.661) (3.322,1.639) (3.344,1.62) (3.366,1.603) (3.388,1.588) (3.41,1.576) (3.432,1.566) (3.454,1.558) (3.476,1.554) (3.498,1.552) (3.52,1.552) (3.542,1.555) (3.564,1.561) (3.586,1.569) (3.608,1.579) (3.63,1.592) (3.652,1.608) (3.674,1.625) (3.696,1.645) (3.718,1.666) (3.74,1.69) (3.762,1.715) (3.784,1.741) (3.806,1.769) (3.828,1.797) (3.85,1.827) (3.872,1.857) (3.894,1.888) (3.916,1.918) (3.938,1.949) (3.96,1.98) (3.982,2.01) (4.004,2.04) (4.026,2.068) (4.048,2.096) (4.07,2.122) (4.092,2.147) (4.114,2.17) (4.136,2.191) (4.158,2.21) (4.18,2.228) (4.202,2.242) (4.224,2.255) (4.246,2.265) (4.268,2.272) (4.29,2.276) (4.312,2.278) (4.334,2.277) (4.356,2.273) (4.378,2.267) (4.4,2.258) (4.422,2.245) (4.444,2.231) (4.466,2.213) (4.488,2.193) (4.51,2.171) (4.532,2.146) (4.554,2.119) (4.576,2.09) (4.598,2.059) (4.62,2.026) (4.642,1.992) (4.664,1.957) (4.686,1.92) (4.708,1.883) (4.73,1.845) (4.752,1.807) (4.774,1.768) (4.796,1.73) (4.818,1.691) (4.84,1.654) (4.862,1.617) (4.884,1.581) (4.906,1.546) (4.928,1.513) (4.95,1.481) (4.972,1.452) (4.994,1.424) (5.016,1.398) (5.038,1.375) (5.06,1.355) (5.082,1.337) (5.104,1.322) (5.126,1.309) (5.148,1.3) (5.17,1.294) (5.192,1.291) (5.214,1.291) (5.236,1.295) (5.258,1.301) (5.28,1.311) (5.302,1.324) (5.324,1.34) (5.346,1.359) (5.368,1.381) (5.39,1.406) (5.412,1.433) (5.434,1.463) (5.456,1.496) (5.478,1.531) (5.5,1.568) (5.522,1.606) (5.544,1.647) (5.566,1.689) (5.588,1.733) (5.61,1.777) (5.632,1.823) (5.654,1.869) (5.676,1.916) (5.698,1.963) (5.72,2.01) (5.742,2.057) (5.764,2.104) (5.786,2.15) (5.808,2.195) (5.83,2.24) (5.852,2.283) (5.874,2.325) (5.896,2.366) (5.918,2.405) (5.94,2.442) (5.962,2.477) (5.984,2.511) (6.006,2.542) (6.028,2.572) (6.05,2.599) (6.072,2.624) (6.094,2.646) (6.116,2.667) (6.138,2.685) (6.16,2.701) (6.182,2.714) (6.204,2.726) (6.226,2.735) (6.248,2.742) (6.27,2.748) (6.292,2.751) (6.314,2.752) (6.336,2.752) (6.358,2.751) (6.38,2.748) (6.402,2.743) (6.424,2.738) (6.446,2.731) (6.468,2.724) (6.49,2.716) (6.512,2.707) (6.534,2.698) (6.556,2.689) (6.578,2.679) (6.6,2.67)};846\fill[fwd] (1.702,2.073) circle (1.9pt);847\draw[fwd,fill=white] (2.052,2.073) circle (1.9pt);848\fill[fwd] (3.004,2.073) circle (1.9pt);849\draw[fwd,fill=white] (4.03,2.073) circle (1.9pt);850\fill[fwd] (4.588,2.073) circle (1.9pt);851\draw[fwd,fill=white] (5.749,2.073) circle (1.9pt);852\draw[thick,accent] plot coordinates {(0,2.67) (0.022,2.665) (0.044,2.661) (0.066,2.658) (0.088,2.655) (0.11,2.652) (0.132,2.651) (0.154,2.65) (0.176,2.65) (0.198,2.651) (0.22,2.653) (0.242,2.656) (0.264,2.66) (0.286,2.665) (0.308,2.671) (0.33,2.678) (0.352,2.687) (0.374,2.696) (0.396,2.707) (0.418,2.718) (0.44,2.73) (0.462,2.743) (0.484,2.757) (0.506,2.771) (0.528,2.786) (0.55,2.801) (0.572,2.817) (0.594,2.832) (0.616,2.848) (0.638,2.864) (0.66,2.879) (0.682,2.894) (0.704,2.909) (0.726,2.923) (0.748,2.936) (0.77,2.948) (0.792,2.96) (0.814,2.97) (0.836,2.98) (0.858,2.987) (0.88,2.994) (0.902,2.999) (0.924,3.003) (0.946,3.005) (0.968,3.005) (0.99,3.004) (1.012,3.001) (1.034,2.997) (1.056,2.991) (1.078,2.983) (1.1,2.973) (1.122,2.962) (1.144,2.949) (1.166,2.935) (1.188,2.92) (1.21,2.903) (1.232,2.884) (1.254,2.865) (1.276,2.845) (1.298,2.824) (1.32,2.802) (1.342,2.779) (1.364,2.756) (1.386,2.733) (1.408,2.71) (1.43,2.686) (1.452,2.663) (1.474,2.64) (1.496,2.617) (1.518,2.595) (1.54,2.574) (1.562,2.554) (1.584,2.535) (1.606,2.517) (1.628,2.5) (1.65,2.485) (1.672,2.472) (1.694,2.46) (1.716,2.45) (1.738,2.441) (1.76,2.435) (1.782,2.43) (1.804,2.428) (1.826,2.427) (1.848,2.429) (1.87,2.433) (1.892,2.438) (1.914,2.446) (1.936,2.455) (1.958,2.467) (1.98,2.48) (2.002,2.495) (2.024,2.511) (2.046,2.529) (2.068,2.549) (2.09,2.569) (2.112,2.591) (2.134,2.614) (2.156,2.638) (2.178,2.662) (2.2,2.687) (2.222,2.712) (2.244,2.737) (2.266,2.762) (2.288,2.787) (2.31,2.811) (2.332,2.835) (2.354,2.858) (2.376,2.88) (2.398,2.901) (2.42,2.921) (2.442,2.939) (2.464,2.956) (2.486,2.971) (2.508,2.985) (2.53,2.996) (2.552,3.005) (2.574,3.013) (2.596,3.018) (2.618,3.021) (2.64,3.022) (2.662,3.021) (2.684,3.017) (2.706,3.011) (2.728,3.003) (2.75,2.993) (2.772,2.98) (2.794,2.966) (2.816,2.949) (2.838,2.931) (2.86,2.911) (2.882,2.889) (2.904,2.866) (2.926,2.842) (2.948,2.816) (2.97,2.79) (2.992,2.762) (3.014,2.734) (3.036,2.706) (3.058,2.677) (3.08,2.649) (3.102,2.62) (3.124,2.592) (3.146,2.564) (3.168,2.537) (3.19,2.511) (3.212,2.487) (3.234,2.463) (3.256,2.441) (3.278,2.421) (3.3,2.402) (3.322,2.386) (3.344,2.372) (3.366,2.359) (3.388,2.35) (3.41,2.342) (3.432,2.337) (3.454,2.335) (3.476,2.335) (3.498,2.338) (3.52,2.343) (3.542,2.351) (3.564,2.362) (3.586,2.375) (3.608,2.39) (3.63,2.408) (3.652,2.428) (3.674,2.451) (3.696,2.475) (3.718,2.502) (3.74,2.53) (3.762,2.56) (3.784,2.591) (3.806,2.624) (3.828,2.658) (3.85,2.692) (3.872,2.727) (3.894,2.763) (3.916,2.799) (3.938,2.834) (3.96,2.87) (3.982,2.905) (4.004,2.939) (4.026,2.973) (4.048,3.005) (4.07,3.037) (4.092,3.066) (4.114,3.094) (4.136,3.121) (4.158,3.145) (4.18,3.167) (4.202,3.187) (4.224,3.204) (4.246,3.219) (4.268,3.231) (4.29,3.241) (4.312,3.247) (4.334,3.251) (4.356,3.252) (4.378,3.251) (4.4,3.246) (4.422,3.239) (4.444,3.229) (4.466,3.217) (4.488,3.202) (4.51,3.184) (4.532,3.164) (4.554,3.142) (4.576,3.118) (4.598,3.092) (4.62,3.065) (4.642,3.035) (4.664,3.005) (4.686,2.973) (4.708,2.941) (4.73,2.908) (4.752,2.875) (4.774,2.841) (4.796,2.807) (4.818,2.774) (4.84,2.741) (4.862,2.709) (4.884,2.679) (4.906,2.649) (4.928,2.62) (4.95,2.594) (4.972,2.569) (4.994,2.546) (5.016,2.526) (5.038,2.507) (5.06,2.492) (5.082,2.479) (5.104,2.469) (5.126,2.461) (5.148,2.457) (5.17,2.456) (5.192,2.458) (5.214,2.463) (5.236,2.471) (5.258,2.483) (5.28,2.498) (5.302,2.515) (5.324,2.536) (5.346,2.56) (5.368,2.587) (5.39,2.617) (5.412,2.649) (5.434,2.684) (5.456,2.722) (5.478,2.762) (5.5,2.804) (5.522,2.847) (5.544,2.893) (5.566,2.94) (5.588,2.989) (5.61,3.038) (5.632,3.089) (5.654,3.14) (5.676,3.192) (5.698,3.244) (5.72,3.296) (5.742,3.348) (5.764,3.399) (5.786,3.45) (5.808,3.501) (5.83,3.55) (5.852,3.598) (5.874,3.645) (5.896,3.691) (5.918,3.735) (5.94,3.777) (5.962,3.817) (5.984,3.856) (6.006,3.892) (6.028,3.926) (6.05,3.958) (6.072,3.988) (6.094,4.016) (6.116,4.041) (6.138,4.064) (6.16,4.085) (6.182,4.104) (6.204,4.12) (6.226,4.134) (6.248,4.146) (6.27,4.157) (6.292,4.165) (6.314,4.171) (6.336,4.176) (6.358,4.18) (6.38,4.181) (6.402,4.182) (6.424,4.181) (6.446,4.18) (6.468,4.177) (6.49,4.174) (6.512,4.17) (6.534,4.166) (6.556,4.162) (6.578,4.157) (6.6,4.153)};853\draw[accent,fill=white] (5.833,3.556) circle (1.9pt);854\node[bwd,anchor=west,inner sep=2pt] at (6.6,1.187) {\scriptsize $d=0$};855\node[fwd,anchor=west,inner sep=2pt] at (6.6,2.67) {\scriptsize $d=1$};856\node[accent,anchor=west,inner sep=2pt] at (6.6,4.153) {\scriptsize $d=2$};857\end{scope}858\end{tikzpicture}859\caption{Fixed points of three maps $\theta\mapsto d\theta+\epsilon g(\theta)$ of the circle, with the same $g$. Plotted is the displacement $(d-1)\theta+\epsilon g(\theta)$; a fixed point is a crossing of a multiple of $2\pi$ (dotted). Downward crossings have index $1$ (filled) and upward ones index $-1$ (open). The curve for $d$ climbs by $d-1$ levels in one turn, so the indices add up to $1-d$: here $3$, $6$, $1$ points with sums $1$, $0$, $-1$ for $d=0,1,2$.}\label{fig:circlemap}860\end{figure}861 862\noindent For circle maps $\theta\mapsto d\theta+\epsilon g(\theta)$ with random $g$ and $\epsilon=2$, the fixed863points number $5,7,6,9,8$ for $d=-2,0,1,2,3$ and their indices add up to $3,1,0,-1,-2$ (\cref{fig:circlemap}864shows three maps of the same kind). \chk{N4} For three drift865fields on a torus there are four zeros each, a source, a sink and two saddles. \chk{N5} The consequences differ866by manifold. On a ring or a torus, noise in the weights breaks the continuum of fixed points into isolated ones,867stable and unstable in balance, or removes all of them and leaves a uniform drift, which $\chi=0$ permits. On a868sphere that second outcome is impossible: every perturbation of a spherical attractor keeps a fixed point,869because $\chi=2$.870 871\subsection{Degree and the passage through zero}872 873Let a network produce $u_w(\theta)\in\R^2$ for an input on a circle and output the direction $u_w/|u_w|$. As long874as $u_w$ does not vanish this is a map of the circle to itself with a degree.875 876\begin{theorem}\label{thm:zero}877\Scl[\cite{ADTHC}, Thm.~9.1] \emph{(a)} The degree is the signed number of preimages of any regular direction.878\emph{(b)} Along a path of weights the degree is constant unless $u_w(\theta)=0$ for some $\theta$ and some879weight on the path.880\end{theorem}881 882\begin{figure}[t]883\centering884\begin{tikzpicture}885\draw[ink2,very thin] (0,0)--(1.927,0);886\draw[ink2,very thin] (1.021,-1.254)--(1.021,1.254);887\draw[fwd,thick] plot coordinates {(1.743,-0.243) (1.736,-0.21) (1.73,-0.177) (1.722,-0.144) (1.715,-0.11) (1.706,-0.076) (1.697,-0.043) (1.687,-0.009) (1.677,0.024) (1.666,0.058) (1.654,0.091) (1.642,0.124) (1.63,0.157) (1.617,0.19) (1.603,0.222) (1.589,0.254) (1.574,0.285) (1.559,0.316) (1.543,0.347) (1.527,0.377) (1.511,0.406) (1.494,0.435) (1.477,0.464) (1.459,0.491) (1.441,0.518) (1.423,0.545) (1.404,0.571) (1.385,0.596) (1.365,0.62) (1.345,0.644) (1.325,0.667) (1.305,0.689) (1.284,0.711) (1.262,0.732) (1.241,0.752) (1.219,0.772) (1.197,0.791) (1.174,0.809) (1.151,0.826) (1.128,0.843) (1.105,0.859) (1.081,0.875) (1.057,0.89) (1.033,0.904) (1.009,0.918) (0.984,0.931) (0.96,0.943) (0.935,0.955) (0.91,0.967) (0.886,0.977) (0.861,0.988) (0.837,0.997) (0.813,1.006) (0.789,1.015) (0.765,1.022) (0.742,1.03) (0.719,1.036) (0.696,1.042) (0.674,1.048) (0.653,1.052) (0.632,1.056) (0.611,1.06) (0.591,1.063) (0.572,1.065) (0.553,1.067) (0.535,1.068) (0.518,1.068) (0.501,1.068) (0.484,1.067) (0.469,1.065) (0.454,1.062) (0.439,1.059) (0.425,1.056) (0.412,1.051) (0.399,1.046) (0.386,1.04) (0.374,1.033) (0.362,1.026) (0.351,1.018) (0.341,1.009) (0.33,1) (0.32,0.99) (0.31,0.979) (0.301,0.967) (0.292,0.954) (0.283,0.941) (0.274,0.927) (0.266,0.913) (0.258,0.897) (0.25,0.881) (0.243,0.865) (0.235,0.847) (0.228,0.829) (0.222,0.811) (0.215,0.791) (0.209,0.772) (0.203,0.751) (0.197,0.73) (0.192,0.709) (0.187,0.687) (0.182,0.665) (0.177,0.642) (0.173,0.619) (0.17,0.595) (0.166,0.571) (0.163,0.547) (0.161,0.523) (0.159,0.498) (0.157,0.474) (0.156,0.449) (0.155,0.423) (0.155,0.398) (0.155,0.373) (0.156,0.347) (0.157,0.321) (0.159,0.296) (0.162,0.27) (0.164,0.244) (0.168,0.218) (0.172,0.192) (0.176,0.166) (0.182,0.14) (0.187,0.114) (0.193,0.088) (0.2,0.062) (0.208,0.037) (0.215,0.011) (0.224,-0.015) (0.233,-0.04) (0.243,-0.065) (0.253,-0.091) (0.264,-0.116) (0.275,-0.141) (0.287,-0.166) (0.3,-0.19) (0.313,-0.215) (0.327,-0.239) (0.342,-0.263) (0.357,-0.287) (0.373,-0.311) (0.39,-0.335) (0.407,-0.359) (0.425,-0.382) (0.444,-0.405) (0.463,-0.429) (0.483,-0.452) (0.504,-0.474) (0.526,-0.497) (0.548,-0.52) (0.571,-0.542) (0.595,-0.564) (0.619,-0.586) (0.644,-0.608) (0.67,-0.629) (0.696,-0.651) (0.722,-0.672) (0.75,-0.693) (0.777,-0.713) (0.805,-0.733) (0.834,-0.753) (0.862,-0.773) (0.891,-0.792) (0.92,-0.81) (0.949,-0.828) (0.978,-0.846) (1.007,-0.864) (1.036,-0.88) (1.065,-0.896) (1.093,-0.912) (1.121,-0.927) (1.149,-0.942) (1.176,-0.956) (1.202,-0.969) (1.228,-0.982) (1.254,-0.994) (1.278,-1.005) (1.302,-1.016) (1.325,-1.026) (1.348,-1.036) (1.369,-1.044) (1.39,-1.053) (1.41,-1.06) (1.429,-1.067) (1.447,-1.073) (1.465,-1.079) (1.482,-1.084) (1.498,-1.088) (1.513,-1.091) (1.527,-1.094) (1.541,-1.097) (1.554,-1.098) (1.567,-1.099) (1.579,-1.099) (1.59,-1.099) (1.601,-1.098) (1.611,-1.097) (1.621,-1.094) (1.63,-1.091) (1.639,-1.088) (1.647,-1.083) (1.655,-1.078) (1.663,-1.072) (1.67,-1.066) (1.677,-1.059) (1.683,-1.051) (1.69,-1.042) (1.696,-1.032) (1.702,-1.022) (1.707,-1.011) (1.712,-0.999) (1.718,-0.986) (1.722,-0.973) (1.727,-0.958) (1.732,-0.943) (1.736,-0.927) (1.74,-0.91) (1.744,-0.892) (1.748,-0.873) (1.751,-0.854) (1.755,-0.833) (1.758,-0.812) (1.76,-0.79) (1.763,-0.767) (1.765,-0.743) (1.767,-0.719) (1.769,-0.694) (1.77,-0.668) (1.771,-0.641) (1.772,-0.613) (1.772,-0.585) (1.772,-0.557) (1.771,-0.528) (1.77,-0.498) (1.769,-0.467) (1.767,-0.437) (1.764,-0.405) (1.761,-0.374) (1.757,-0.342) (1.753,-0.309) (1.748,-0.276) (1.743,-0.243)};888\draw[fwd,thick,-{Stealth[length=4pt]}] (1.325,0.667)--(1.284,0.711);889\fill[accent] (1.021,0) circle (1.8pt);890\node at (0.964,-1.504) {\scriptsize $b=0$};891\node at (0.964,-1.824) {\scriptsize degree $1$};892\draw[ink2,very thin] (2.277,0)--(4.204,0);893\draw[ink2,very thin] (2.496,-1.254)--(2.496,1.254);894\draw[fwd,thick] plot coordinates {(4.02,-0.243) (4.014,-0.21) (4.007,-0.177) (4,-0.144) (3.992,-0.11) (3.983,-0.076) (3.974,-0.043) (3.964,-0.009) (3.954,0.024) (3.943,0.058) (3.932,0.091) (3.92,0.124) (3.907,0.157) (3.894,0.19) (3.88,0.222) (3.866,0.254) (3.851,0.285) (3.836,0.316) (3.821,0.347) (3.805,0.377) (3.788,0.406) (3.771,0.435) (3.754,0.464) (3.736,0.491) (3.718,0.518) (3.7,0.545) (3.681,0.571) (3.662,0.596) (3.642,0.62) (3.623,0.644) (3.602,0.667) (3.582,0.689) (3.561,0.711) (3.54,0.732) (3.518,0.752) (3.496,0.772) (3.474,0.791) (3.451,0.809) (3.429,0.826) (3.405,0.843) (3.382,0.859) (3.358,0.875) (3.334,0.89) (3.31,0.904) (3.286,0.918) (3.261,0.931) (3.237,0.943) (3.212,0.955) (3.188,0.967) (3.163,0.977) (3.139,0.988) (3.114,0.997) (3.09,1.006) (3.066,1.015) (3.042,1.022) (3.019,1.03) (2.996,1.036) (2.973,1.042) (2.951,1.048) (2.93,1.052) (2.909,1.056) (2.888,1.06) (2.868,1.063) (2.849,1.065) (2.83,1.067) (2.812,1.068) (2.795,1.068) (2.778,1.068) (2.762,1.067) (2.746,1.065) (2.731,1.062) (2.716,1.059) (2.702,1.056) (2.689,1.051) (2.676,1.046) (2.663,1.04) (2.651,1.033) (2.64,1.026) (2.629,1.018) (2.618,1.009) (2.607,1) (2.597,0.99) (2.588,0.979) (2.578,0.967) (2.569,0.954) (2.56,0.941) (2.552,0.927) (2.543,0.913) (2.535,0.897) (2.527,0.881) (2.52,0.865) (2.513,0.847) (2.506,0.829) (2.499,0.811) (2.492,0.791) (2.486,0.772) (2.48,0.751) (2.474,0.73) (2.469,0.709) (2.464,0.687) (2.459,0.665) (2.455,0.642) (2.451,0.619) (2.447,0.595) (2.443,0.571) (2.441,0.547) (2.438,0.523) (2.436,0.498) (2.434,0.474) (2.433,0.449) (2.432,0.423) (2.432,0.398) (2.433,0.373) (2.433,0.347) (2.435,0.321) (2.436,0.296) (2.439,0.27) (2.442,0.244) (2.445,0.218) (2.449,0.192) (2.454,0.166) (2.459,0.14) (2.464,0.114) (2.471,0.088) (2.477,0.062) (2.485,0.037) (2.493,0.011) (2.501,-0.015) (2.51,-0.04) (2.52,-0.065) (2.53,-0.091) (2.541,-0.116) (2.552,-0.141) (2.564,-0.166) (2.577,-0.19) (2.59,-0.215) (2.604,-0.239) (2.619,-0.263) (2.634,-0.287) (2.65,-0.311) (2.667,-0.335) (2.684,-0.359) (2.702,-0.382) (2.721,-0.405) (2.74,-0.429) (2.761,-0.452) (2.781,-0.474) (2.803,-0.497) (2.825,-0.52) (2.848,-0.542) (2.872,-0.564) (2.896,-0.586) (2.921,-0.608) (2.947,-0.629) (2.973,-0.651) (3,-0.672) (3.027,-0.693) (3.054,-0.713) (3.082,-0.733) (3.111,-0.753) (3.139,-0.773) (3.168,-0.792) (3.197,-0.81) (3.226,-0.828) (3.255,-0.846) (3.284,-0.864) (3.313,-0.88) (3.342,-0.896) (3.37,-0.912) (3.398,-0.927) (3.426,-0.942) (3.453,-0.956) (3.48,-0.969) (3.505,-0.982) (3.531,-0.994) (3.555,-1.005) (3.579,-1.016) (3.602,-1.026) (3.625,-1.036) (3.646,-1.044) (3.667,-1.053) (3.687,-1.06) (3.706,-1.067) (3.725,-1.073) (3.742,-1.079) (3.759,-1.084) (3.775,-1.088) (3.79,-1.091) (3.805,-1.094) (3.818,-1.097) (3.832,-1.098) (3.844,-1.099) (3.856,-1.099) (3.867,-1.099) (3.878,-1.098) (3.888,-1.097) (3.898,-1.094) (3.907,-1.091) (3.916,-1.088) (3.924,-1.083) (3.932,-1.078) (3.94,-1.072) (3.947,-1.066) (3.954,-1.059) (3.961,-1.051) (3.967,-1.042) (3.973,-1.032) (3.979,-1.022) (3.984,-1.011) (3.99,-0.999) (3.995,-0.986) (4,-0.973) (4.004,-0.958) (4.009,-0.943) (4.013,-0.927) (4.017,-0.91) (4.021,-0.892) (4.025,-0.873) (4.029,-0.854) (4.032,-0.833) (4.035,-0.812) (4.038,-0.79) (4.04,-0.767) (4.043,-0.743) (4.045,-0.719) (4.046,-0.694) (4.048,-0.668) (4.049,-0.641) (4.049,-0.613) (4.049,-0.585) (4.049,-0.557) (4.049,-0.528) (4.048,-0.498) (4.046,-0.467) (4.044,-0.437) (4.041,-0.405) (4.038,-0.374) (4.034,-0.342) (4.03,-0.309) (4.025,-0.276) (4.02,-0.243)};