Independent scholarship · Open accessThe monthly digest

Indexed text attachment

algebraic-and-differential-topology-in-machine-learning-and-ai.tex

Source for Algebraic and Differential Topology in Machine Learning and AI: Obstructions, Invariants, and Counts

View paper · Download original file

Lines 1001–1055 of 1055. Source text is displayed literally.

1001\texttt{verify-topology-learning.py} runs in about ten seconds and prints one line per check.1002\textbf{O1--O3} antipodal collisions of codes on the circle and the sphere, and the radius of the worst fibre;1003\textbf{O4, O5} steps of four codes for rotations along a full turn, and the Gram--Schmidt decoder;1004\textbf{O6} index sums on five triangulated surfaces;1005\textbf{O7, O8} piecewise linear functions as rectifier networks, and winding numbers of polygons;1006\textbf{O9} windings and pieces of the iterated doubling map;1007\textbf{O10} decision regions of narrow networks, and a bounded region with three units;1008\textbf{O11} the quaternion frame on the $3$-sphere;1009\textbf{V1--V3} Hodge Laplacians, coefficients, and convergence of diffusion;1010\textbf{V4--V6} Rips complexes of equally spaced and of random points on a circle;1011\textbf{V7} bottleneck distances between persistence diagrams of perturbed functions;1012\textbf{N1, N2} junctions of nearest-prototype classifiers in dimensions two and three;1013\textbf{N3} the length of the Sperner walk;1014\textbf{N4, N5} fixed points of circle maps and zeros of fields on a torus;1015\textbf{N6} the degree of a small network and the bias at which it changes;1016\textbf{N7} zeros of odd networks on a circle.1017Homology is computed exactly, by Smith normal form over the integers and Gaussian elimination over prime1018fields, with the library of the companion volume. Random inputs use fixed seeds. The figures were drawn1019by a separate plotting script from the same formulas and are embedded in the source as coordinates.1020 1021\begin{thebibliography}{DFdC$^{+}$18}\footnotesize\setlength{\itemsep}{0.5pt}1022\newcommand{\bi}[1]{\bibitem[#1]{#1}}1023\bi{ABMM18} R.~Arora, A.~Basu, P.~Mianjy, A.~Mukherjee, Understanding deep neural networks with rectified linear units, \emph{Proc.\ ICLR} 2018.1024\bi{Ada13} M.~Adamaszek, Clique complexes and graph powers, \emph{Israel J.~Math.} 196 (2013), 295--319.1025\bi{AdAd17} M.~Adamaszek, H.~Adams, The Vietoris--Rips complexes of a circle, \emph{Pacific J.~Math.} 290 (2017), 1--40. Checked.1026\bi{ADTHC} Anonymous, \emph{Algebraic and Differential Topology in Higher Categories}, Higher Categorical Semantics, 2026. Companion volume.1027\bi{Ban67} T.~Banchoff, Critical points and curvature for embedded polyhedra, \emph{J.~Differential Geom.} 1 (1967), 245--256.1028\bi{BBS95} R.~Ben-Yishai, R.~L.~Bar-Or, H.~Sompolinsky, Theory of orientation tuning in visual cortex, \emph{Proc.\ Nat.\ Acad.\ Sci.\ U.S.A.} 92 (1995), 3844--3848.1029\bibitem[BFW$^{+}$21]{BFW21} C.~Bodnar, F.~Frasca, Y.~Wang, N.~Otter, G.~Mont\'ufar, P.~Li\`o, M.~Bronstein, Weisfeiler and Lehman go topological: message passing simplicial networks, \emph{Proc.\ ICML} 2021.1030\bi{BKK19} S.~Bai, J.~Z.~Kolter, V.~Koltun, Deep equilibrium models, \emph{Adv.\ Neural Inf.\ Process.\ Syst.} 32 (2019).1031\bi{Car09} G.~Carlsson, Topology and data, \emph{Bull.\ Amer.\ Math.\ Soc.} 46 (2009), 255--308.1032\bi{CEH07} D.~Cohen-Steiner, H.~Edelsbrunner, J.~Harer, Stability of persistence diagrams, \emph{Discrete Comput.\ Geom.} 37 (2007), 103--120.1033\bi{CWKW19} T.~Cohen, M.~Weiler, B.~Kicanaoglu, M.~Welling, Gauge equivariant convolutional networks and the icosahedral CNN, \emph{Proc.\ ICML} 2019.1034\bibitem[DFdC$^{+}$18]{DFdC18} T.~R.~Davidson, L.~Falorsi, N.~De~Cao, T.~Kipf, J.~M.~Tomczak, Hyperspherical variational auto-encoders, \emph{Proc.\ UAI} 2018.1035\bi{DGP09} C.~Daskalakis, P.~W.~Goldberg, C.~H.~Papadimitriou, The complexity of computing a Nash equilibrium, \emph{SIAM J.~Comput.} 39 (2009), 195--259.1036\bi{Eck44} B.~Eckmann, Harmonische Funktionen und Randwertaufgaben in einem Komplex, \emph{Comment.\ Math.\ Helv.} 17 (1944), 240--255.1037\bi{EdHa10} H.~Edelsbrunner, J.~Harer, \emph{Computational Topology: An Introduction}, American Mathematical Society, 2010.1038\bi{EDS20} S.~Ebli, M.~Defferrard, G.~Spreemann, Simplicial neural networks, NeurIPS Workshop on Topological Data Analysis and Beyond, 2020.1039\bibitem[FdH$^{+}$18]{FdH18} L.~Falorsi, P.~de~Haan, T.~R.~Davidson, N.~De~Cao, M.~Weiler, P.~Forr\'e, T.~S.~Cohen, Explorations in homeomorphic variational auto-encoding, ICML Workshop on Theoretical Foundations and Applications of Deep Generative Models, 2018.1040\bibitem[GHP$^{+}$22]{GHP22} R.~J.~Gardner, E.~Hermansen, M.~Pachitariu, Y.~Burak, N.~A.~Baas, B.~A.~Dunn, M.-B.~Moser, E.~I.~Moser, Toroidal topology of population activity in grid cells, \emph{Nature} 602 (2022), 123--128.1041\bi{HaSe17} B.~Hanin, M.~Sellke, Approximating continuous functions by ReLU nets of minimal width, arXiv:1710.11278, 2017.1042\bi{Joh19} J.~Johnson, Deep, skinny neural networks are not universal approximators, \emph{Proc.\ ICLR} 2019.1043\bi{Lim20} L.-H.~Lim, Hodge Laplacians on graphs, \emph{SIAM Rev.} 62 (2020), 685--715.1044\bi{Mat03} J.~Matou\v{s}ek, \emph{Using the Borsuk--Ulam Theorem}, Springer, 2003.1045\bi{NSW08} P.~Niyogi, S.~Smale, S.~Weinberger, Finding the homology of submanifolds with high confidence from random samples, \emph{Discrete Comput.\ Geom.} 39 (2008), 419--441.1046\bi{NZL20} G.~Naitzat, A.~Zhitnikov, L.-H.~Lim, Topology of deep neural networks, \emph{J.~Mach.\ Learn.\ Res.} 21 (2020), no.~184, 1--40.1047\bi{Pap94} C.~H.~Papadimitriou, On the complexity of the parity argument and other inefficient proofs of existence, \emph{J.~Comput.\ System Sci.} 48 (1994), 498--532.1048\bibitem[PBB$^{+}$24]{PBB24} T.~Papamarkou, T.~Birdal, M.~Bronstein, G.~Carlsson, J.~Curry, Y.~Gao, M.~Hajij, R.~Kwitt, P.~Li\`o, P.~Di~Lorenzo, V.~Maroulas, N.~Miolane, F.~Nasrin, K.~N.~Ramamurthy, B.~Rieck, S.~Scardapane, M.~T.~Schaub, P.~Veli\v{c}kovi\'c, B.~Wang, Y.~Wang, G.-W.~Wei, G.~Zamzmi, Position: topological deep learning is the new frontier for relational learning, \emph{Proc.\ ICML} 2024, PMLR 235, 39529--39555. Checked.1049\bi{SHSFG19} A.~Shafahi, W.~R.~Huang, C.~Studer, S.~Feizi, T.~Goldstein, Are adversarial examples inevitable?, \emph{Proc.\ ICLR} 2019.1050\bi{Tel16} M.~Telgarsky, Benefits of depth in neural networks, \emph{Proc.\ COLT} 2016, PMLR 49, 1517--1539.1051\bi{ZBLYL19} Y.~Zhou, C.~Barnes, J.~Lu, J.~Yang, H.~Li, On the continuity of rotation representations in neural networks, \emph{Proc.\ CVPR} 2019, 5745--5753. Checked.1052\bi{Zha96} K.~Zhang, Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory, \emph{J.~Neurosci.} 16 (1996), 2112--2126.1053\end{thebibliography}1054\end{document}1055