Indexed text attachment
differential-topology-of-parametrized-neural-networks.tex
Source for Differential Topology of Parametrized Neural Networks
View paper · Download original file
Lines 981–1074 of 1074. Source text is displayed literally.
981a population loss.982\par983\section{Conclusion}984 985The analysis separates three conditions on a parametrized network.986The available weight directions determine where the total jet987map is transverse. The symmetry representation determines which988normal derivatives a fixed realization can have at a stabilizer.989The topology of the domain and latent factorization determines990which global reconstructions are possible. A model can satisfy991one of these conditions while exhibiting an obstruction governed992by another.993 994Examples on the circle and torus make these distinctions explicit.995Ordinary point counts jump at the fold discriminant. They can996also remain constant while boundary sheets are permuted along a997regular parameter loop. The resulting persistence module over998the parameter retains that permutation representation. In the999equivariant torus model the squared residual controls normal1000movement, while the tangent complex records an excess target1001direction. The autoencoder estimates bound uniform reconstruction1002error and give a separate mean-square bound under a Lipschitz1003constraint.1004 1005Relative evaluation and descent explain how these calculations1006pass between local presentations of a model. The assumptions1007used for the calculations are geometric: smoothness of the1008relevant charts, specified perturbation directions, properness1009for topology of fibers, and an explicit choice of decoder range.1010They apply to a realized architecture once those hypotheses1011have been checked.1012\par1013\balance1014\begin{thebibliography}{99}1015\small\raggedright1016 1017\bibitem{higher-hirsch}1018Anonymous. \emph{Differential Topology in Higher Categories:1019From Regular Values and Cobordism to Derived Smooth Families}.1020Submitted manuscript, 2026.1021 1022\bibitem{previous-networks}1023Anonymous. Representation theory of parametrized neural models1024on spaces. \emph{Higher Categorical Semantics}, 2026.1025\href{https://higher-categorical-semantics.pages.dev/research/representation-theory-of-parametrized-neural-models-on-spaces-ae10d3ed}{Published article}.1026 1027\bibitem{batson-autoencoders}1028J. Batson, C. G. Haaf, Y. Kahn, and D. A. Roberts.1029Topological obstructions to autoencoding.1030\emph{Journal of High Energy Physics} 04 (2021), 280.1031\href{https://doi.org/10.1007/JHEP04(2021)280}{DOI}.1032 1033\bibitem{chazal-persistence}1034F. Chazal, V. de Silva, M. Glisse, and S. Oudot.1035\emph{The Structure and Stability of Persistence Modules}.1036Springer, 2016.1037\href{https://doi.org/10.1007/978-3-319-42545-0}{DOI}.1038 1039\bibitem{cohen-steiner-stability}1040D. Cohen-Steiner, H. Edelsbrunner, and J. Harer.1041Stability of persistence diagrams.1042\emph{Discrete \& Computational Geometry} 37 (2007), 103--120.1043\href{https://doi.org/10.1007/s00454-006-1276-5}{DOI}.1044 1045\bibitem{fong-spivak-tuyeras}1046B. Fong, D. I. Spivak, and R. Tuy\'eras.1047Backprop as functor: A compositional perspective on supervised learning.1048In \emph{Proceedings of LICS}, 2019.1049\href{https://hdl.handle.net/1721.1/123513}{Author manuscript}.1050 1051\bibitem{hatcher-at}1052A. Hatcher. \emph{Algebraic Topology}.1053Cambridge University Press, 2002.1054\href{https://pi.math.cornell.edu/~hatcher/AT/at1-tc.html}{Author's copy}.1055 1056\bibitem{hirsch}1057M. W. Hirsch. \emph{Differential Topology}.1058Graduate Texts in Mathematics 33. Springer, 1976.1059\href{https://link.springer.com/book/10.1007/978-1-4684-9449-5}{Publisher's edition}.1060 1061\bibitem{matousek-borsuk}1062J. Matou\v{s}ek. \emph{Using the Borsuk--Ulam Theorem}.1063Springer, 2003.1064\href{https://doi.org/10.1007/978-3-540-76649-0}{DOI}.1065 1066\bibitem{naitzat}1067G. Naitzat, A. Zhitnikov, and L.-H. Lim.1068Topology of deep neural networks.1069\emph{Journal of Machine Learning Research} 21(184) (2020), 1--40.1070\href{https://www.jmlr.org/papers/v21/20-345.html}{Journal article}.1071 1072\end{thebibliography}1073\end{document}1074