Indexed text attachment
algebraic-and-differential-topology-in-machine-learning-and-ai.tex
Source for Algebraic and Differential Topology in Machine Learning and AI: Obstructions, Invariants, and Counts
View paper · Download original file
Lines 1015–1055 of 1055. Source text is displayed literally.
1015\textbf{N6} the degree of a small network and the bias at which it changes;1016\textbf{N7} zeros of odd networks on a circle.1017Homology is computed exactly, by Smith normal form over the integers and Gaussian elimination over prime1018fields, with the library of the companion volume. Random inputs use fixed seeds. The figures were drawn1019by a separate plotting script from the same formulas and are embedded in the source as coordinates.1020 1021\begin{thebibliography}{DFdC$^{+}$18}\footnotesize\setlength{\itemsep}{0.5pt}1022\newcommand{\bi}[1]{\bibitem[#1]{#1}}1023\bi{ABMM18} R.~Arora, A.~Basu, P.~Mianjy, A.~Mukherjee, Understanding deep neural networks with rectified linear units, \emph{Proc.\ ICLR} 2018.1024\bi{Ada13} M.~Adamaszek, Clique complexes and graph powers, \emph{Israel J.~Math.} 196 (2013), 295--319.1025\bi{AdAd17} M.~Adamaszek, H.~Adams, The Vietoris--Rips complexes of a circle, \emph{Pacific J.~Math.} 290 (2017), 1--40. Checked.1026\bi{ADTHC} Anonymous, \emph{Algebraic and Differential Topology in Higher Categories}, Higher Categorical Semantics, 2026. Companion volume.1027\bi{Ban67} T.~Banchoff, Critical points and curvature for embedded polyhedra, \emph{J.~Differential Geom.} 1 (1967), 245--256.1028\bi{BBS95} R.~Ben-Yishai, R.~L.~Bar-Or, H.~Sompolinsky, Theory of orientation tuning in visual cortex, \emph{Proc.\ Nat.\ Acad.\ Sci.\ U.S.A.} 92 (1995), 3844--3848.1029\bibitem[BFW$^{+}$21]{BFW21} C.~Bodnar, F.~Frasca, Y.~Wang, N.~Otter, G.~Mont\'ufar, P.~Li\`o, M.~Bronstein, Weisfeiler and Lehman go topological: message passing simplicial networks, \emph{Proc.\ ICML} 2021.1030\bi{BKK19} S.~Bai, J.~Z.~Kolter, V.~Koltun, Deep equilibrium models, \emph{Adv.\ Neural Inf.\ Process.\ Syst.} 32 (2019).1031\bi{Car09} G.~Carlsson, Topology and data, \emph{Bull.\ Amer.\ Math.\ Soc.} 46 (2009), 255--308.1032\bi{CEH07} D.~Cohen-Steiner, H.~Edelsbrunner, J.~Harer, Stability of persistence diagrams, \emph{Discrete Comput.\ Geom.} 37 (2007), 103--120.1033\bi{CWKW19} T.~Cohen, M.~Weiler, B.~Kicanaoglu, M.~Welling, Gauge equivariant convolutional networks and the icosahedral CNN, \emph{Proc.\ ICML} 2019.1034\bibitem[DFdC$^{+}$18]{DFdC18} T.~R.~Davidson, L.~Falorsi, N.~De~Cao, T.~Kipf, J.~M.~Tomczak, Hyperspherical variational auto-encoders, \emph{Proc.\ UAI} 2018.1035\bi{DGP09} C.~Daskalakis, P.~W.~Goldberg, C.~H.~Papadimitriou, The complexity of computing a Nash equilibrium, \emph{SIAM J.~Comput.} 39 (2009), 195--259.1036\bi{Eck44} B.~Eckmann, Harmonische Funktionen und Randwertaufgaben in einem Komplex, \emph{Comment.\ Math.\ Helv.} 17 (1944), 240--255.1037\bi{EdHa10} H.~Edelsbrunner, J.~Harer, \emph{Computational Topology: An Introduction}, American Mathematical Society, 2010.1038\bi{EDS20} S.~Ebli, M.~Defferrard, G.~Spreemann, Simplicial neural networks, NeurIPS Workshop on Topological Data Analysis and Beyond, 2020.1039\bibitem[FdH$^{+}$18]{FdH18} L.~Falorsi, P.~de~Haan, T.~R.~Davidson, N.~De~Cao, M.~Weiler, P.~Forr\'e, T.~S.~Cohen, Explorations in homeomorphic variational auto-encoding, ICML Workshop on Theoretical Foundations and Applications of Deep Generative Models, 2018.1040\bibitem[GHP$^{+}$22]{GHP22} R.~J.~Gardner, E.~Hermansen, M.~Pachitariu, Y.~Burak, N.~A.~Baas, B.~A.~Dunn, M.-B.~Moser, E.~I.~Moser, Toroidal topology of population activity in grid cells, \emph{Nature} 602 (2022), 123--128.1041\bi{HaSe17} B.~Hanin, M.~Sellke, Approximating continuous functions by ReLU nets of minimal width, arXiv:1710.11278, 2017.1042\bi{Joh19} J.~Johnson, Deep, skinny neural networks are not universal approximators, \emph{Proc.\ ICLR} 2019.1043\bi{Lim20} L.-H.~Lim, Hodge Laplacians on graphs, \emph{SIAM Rev.} 62 (2020), 685--715.1044\bi{Mat03} J.~Matou\v{s}ek, \emph{Using the Borsuk--Ulam Theorem}, Springer, 2003.1045\bi{NSW08} P.~Niyogi, S.~Smale, S.~Weinberger, Finding the homology of submanifolds with high confidence from random samples, \emph{Discrete Comput.\ Geom.} 39 (2008), 419--441.1046\bi{NZL20} G.~Naitzat, A.~Zhitnikov, L.-H.~Lim, Topology of deep neural networks, \emph{J.~Mach.\ Learn.\ Res.} 21 (2020), no.~184, 1--40.1047\bi{Pap94} C.~H.~Papadimitriou, On the complexity of the parity argument and other inefficient proofs of existence, \emph{J.~Comput.\ System Sci.} 48 (1994), 498--532.1048\bibitem[PBB$^{+}$24]{PBB24} T.~Papamarkou, T.~Birdal, M.~Bronstein, G.~Carlsson, J.~Curry, Y.~Gao, M.~Hajij, R.~Kwitt, P.~Li\`o, P.~Di~Lorenzo, V.~Maroulas, N.~Miolane, F.~Nasrin, K.~N.~Ramamurthy, B.~Rieck, S.~Scardapane, M.~T.~Schaub, P.~Veli\v{c}kovi\'c, B.~Wang, Y.~Wang, G.-W.~Wei, G.~Zamzmi, Position: topological deep learning is the new frontier for relational learning, \emph{Proc.\ ICML} 2024, PMLR 235, 39529--39555. Checked.1049\bi{SHSFG19} A.~Shafahi, W.~R.~Huang, C.~Studer, S.~Feizi, T.~Goldstein, Are adversarial examples inevitable?, \emph{Proc.\ ICLR} 2019.1050\bi{Tel16} M.~Telgarsky, Benefits of depth in neural networks, \emph{Proc.\ COLT} 2016, PMLR 49, 1517--1539.1051\bi{ZBLYL19} Y.~Zhou, C.~Barnes, J.~Lu, J.~Yang, H.~Li, On the continuity of rotation representations in neural networks, \emph{Proc.\ CVPR} 2019, 5745--5753. Checked.1052\bi{Zha96} K.~Zhang, Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory, \emph{J.~Neurosci.} 16 (1996), 2112--2126.1053\end{thebibliography}1054\end{document}1055