Indexed text attachment
representation-theory-of-parametrized-neural-models-on-spaces.tex
Source for Representation Theory of Parametrized Neural Models on Spaces
View paper · Download original file
Lines 943–1042 of 1343. Source text is displayed literally.
943\end{proof}944 945\subsection{Descent of weights and observables}946 947For a smooth base \(B\), a family in the quotient stack948\([\mathbb R/G]\) consists of a principal \(G\)-bundle \(P\to B\)949and a smooth equivariant function \(w:P\to\mathbb R\). Morphisms950over \(B\) are principal-bundle isomorphisms compatible with \(w\).951This is the torsor description of a quotient stack, using open952covers and local smooth trivializations in this setting953\cite[cf.\ the algebraic version in Tag 04UV]{stacks-quotients}.954Equivalently, choose local frames over an open cover \(U_i\) and955write the coordinates as \(w_i:U_i\to\mathbb R\). The locally956constant signs \(\varepsilon_{ij}\) satisfy957\[958 \varepsilon_{ij}\varepsilon_{jk}=\varepsilon_{ik},959 \qquad w_i=\varepsilon_{ij}w_j .960\]961Changing frames acts by a family of local signs962\(\alpha_i:U_i\to G\), replacing these data by963\(\alpha_i\varepsilon_{ij}\alpha_j^{-1}\) and \(\alpha_iw_i\).964The same signs glue the hidden features \(h_{w_i}\), and the965signs cancel in \(w_i h_{w_i}\). Hence the observable kernel is a966single smooth family \(K:B\times\mathbb R\to967\operatorname{Prob}(\{0,1\})\). The invariant function968\(r(b)=w(p)^2\), for \(p\in P_b\), can be recovered from \(K\)969by differentiating the logit in \(x\) at \(0\).970Both constructions commute with pullback along smooth base maps.971They give maps from the groupoid of families to the set of smooth972nonnegative functions and then to the set of observational laws.973For a fixed base, the second map is injective on the functions974obtained from families by Proposition~\ref{gauge:pointwise}.975The first map can identify nonisomorphic families, as the zero976example below shows.977 978\subsection{Monodromy in the zero fiber}979 980Over \(S^1=\mathbb R/(2\pi\mathbb Z)\), take the connected double981cover \(P_-\) with total space \(\mathbb R/(4\pi\mathbb Z)\) and982deck transformation \(\theta\mapsto\theta+2\pi\). The associated983sign line is the M\"obius bundle984\cite[\S 1.1]{hatcher-vbkt}. Transport once around the circle985switches sheets. For comparison, the trivial double cover986\(P_+=S^1\times G\) preserves each sheet. The connectedness of987\(P_-\) distinguishes it from \(P_+\). Both admit the zero988equivariant weight, and both resulting decoders output probability989\(1/2\) at every base point and input.990 991\begin{proposition}[Families over the zero observable]992\label{gauge:zero}993The groupoid of smooth families on \(S^1\) with constant994observable \(K(1\mid x)=1/2\) is equivalent to995\(BG\amalg BG\).996\end{proposition}997 998\begin{proof}999The recovery formula for \(r\) forces the equivariant function1000\(w\) to be zero, so the whole groupoid consists of \(G\)-torsors1001and their isomorphisms. Cut the circle at one point and trivialize1002a torsor on the intervening interval. The two ends are glued by1003one element of \(G\) acting by multiplication, and changing the1004trivialization conjugates that element. Here \(G\) is abelian,1005so its two elements determine exactly the trivial and connected1006double covers. A torsor automorphism is multiplication by a1007locally constant sign on the base. The circle is connected, so1008each object has automorphism group \(G\).1009\end{proof}1010 1011At a single base point the corresponding fiber is \(BG\).1012The extra isomorphism class over the circle comes from sign1013monodromy. The statistic \(r\) identifies orbits at each point,1014while the stack retains both their automorphisms and their1015compatibility around a loop.1016 1017\subsection{A family with local weights}1018 1019On \(P_-\), the smooth function \(w([\theta])=\cos(\theta/2)\)1020changes sign under the deck transformation, so it is an1021equivariant weight. The descended family has1022\[1023 r([\theta])=\cos^2(\theta/2)=\tfrac12(1+\cos\theta).1024\]1025Its logits and probabilities are smooth by the local gluing1026above. This family cannot be represented by a single smooth1027weight on the circle in the same architecture. Indeed, any such1028weight \(v:S^1\to\mathbb R\) must satisfy \(v^2=r\) by1029Proposition~\ref{gauge:pointwise}. The sole zero of \(r\) is at1030\([\pi]\), where1031\[1032 r([\pi+t])=\tfrac14 t^2+O(t^4).1033\]1034Thus smoothness forces \(v'([\pi])^2=1/4\). A smooth weight with1035this derivative changes sign at its sole zero. The complement1036of that zero in the circle is connected, and a continuous1037nonvanishing real function on it has constant sign, a1038contradiction. The two chartwise signed weights do define the1039model in the quotient stack, with the nontrivial transition1040sign recording the absence of a global frame. The absolute1041value of the local weight yields a continuous scalar lift,1042which shows the role of the smooth category in the obstruction.