Independent scholarship · Open accessThe monthly digest

Indexed text attachment

representation-theory-of-parametrized-neural-models-on-spaces.tex

Source for Representation Theory of Parametrized Neural Models on Spaces

View paper · Download original file

Lines 701–800 of 1343. Source text is displayed literally.

701\end{example}702 703\paragraph{Spin channels.}704For \(S^2=\mathrm{SO}(3)/\mathrm{SO}(2)\), let \(L_m\) correspond705to \(\rho_m(e^{it})=e^{imt}\). The \(\ell\)-th spherical type706\(U_\ell\) restricts to the stabilizer with weights707\(-\ell,\ldots,\ell\), each of multiplicity one.708Thus \(L^2(L_m)\) contains one copy of \(U_\ell\) for709\(\ell\geq |m|\). The section representations at weights \(1\)710and \(-1\) are therefore unitarily equivalent. The oriented711complex tangent line is \(L_1\), and \(L_m\) is its712\(m\)-th tensor power, using duals for \(m<0\).713The tangent Euler number \(2\) gives714\[715 c_1(L_m)=2m\,u,\qquad716 \langle u,[S^2]\rangle=1717\]718\cite[Ch.~3]{hatcher-vbkt}. The two opposite channels therefore719carry inequivalent complex bundles. Fiberwise nonlinear layers720detect the characters directly. A continuous fiber map induced721by \(\phi:\mathbb C\to\mathbb C\) from \(L_2\) to \(L_3\) would722obey \(\phi(e^{2it}v)=e^{3it}\phi(v)\). Taking \(t=\pi\) forces723\(\phi=0\). A nonzero global intertwiner from \(L_2\) to \(L_3\)724is obtained by retaining the common \(\ell=3\) block.725The equivariance constraints on the two operations arise at726different levels of the representation.727 728\paragraph{Manifolds with local frames.}729The kernel description also makes sense without a transitive730global action. On a smooth manifold \(M\), let \(Q\to M\) be731a principal \(H\)-bundle and use \(\rho,\sigma\) as its two732feature representations. Local frames of \(Q\) identify a733kernel \(E_x\to F_y\) with a matrix \(A(y,x)\). Replacing734the frames independently by right translates by735\(h_x,h_y\in H\) transforms the matrix by736\[737 A'(y,x)=\sigma(h_y)^{-1} A(y,x)\rho(h_x).738\]739Indeed, new input coordinates must first be converted to the740old ones by \(\rho(h_x)\), and old output coordinates to new741ones by \(\sigma(h_y)^{-1}\). This relation is exactly the742gluing condition for a section of the bundle with fibers743\(\operatorname{Hom}(E_x,F_y)\) on \(M\times M\). Integration744against a chosen smooth positive density defines a global745layer whenever the kernel satisfies the needed integrability746conditions. Setting \(x=y\) yields the corresponding frame747change for a fiber map. A fiberwise nonlinearity can also be748glued if it obeys the same change of coordinates in the sense749of intertwining the two actions.750 751\paragraph{Quotients and descent.}752For a smooth action on a manifold \(P\), the quotient stacks give753\begin{equation}754 [\,(P\times G/H)/G\,]\ \simeq\ [P/H].755 \label{geo:stack}756\end{equation}757An object over a test manifold consists of a right \(G\)-torsor758with a \(G\)-equivariant map to \(P\times G/H\), with inverse759action on the target in the right-torsor convention. The inverse760image of \(1H\) under the second component is an \(H\)-reduction761of the torsor. The first component restricts to an equivariant762map from that reduction to \(P\). Conversely, extending the763\(H\)-torsor along \(H\hookrightarrow G\) produces the original764object and both maps. The constructions commute with pullback765and identify torsor isomorphisms \cite[Chs.~20, 28]{reprbook}.766For \(P=*\) this gives the smooth classifying stack \(BH\). A representation \(H\to767\mathrm{U}(V)\) then gives a morphism of smooth classifying768stacks and a descended feature bundle. More generally a769homotopy-coherent coefficient system on an action groupoid770retains the diagrams of identifications over all composable771arrows. Formulas \eqref{geo:bi} and \eqref{geo:conv} illustrate772the ordinary continuous case with a chosen invariant measure.773The descent data determine how to transport fibers, while the774measure enters the integration operation separately.775\par776\section{Harmonic decomposition with moving weights}777\label{sec:harmonics}778 779A fixed-parameter equivariant layer can mix multiplicities of an780irreducible representation but preserves its isotypic component.781A moving parameter can carry the difference between the input782and output representation types. This section classifies that783effect for layers linear in the parameter and in the features.784We work with complex Hilbert spaces. The representation $W$785of the compact group $G$ is finite dimensional and unitary,786and $H_X,H_Y$ have strongly continuous unitary actions.787A linear filter family is a complex-linear map788$A:W\to\mathcal B(H_X,H_Y)$, with the equivariance condition789\begin{equation}790 A(gw)=\rho_Y(g) A(w)\rho_X(g)^{-1}.791 \label{eq:filter-covariance}792\end{equation}793Boundedness of the map into the operator norm is automatic794for finite-dimensional $W$.795 796Let $\widehat G$ index the irreducible unitary797representations $V_\pi$. Write $M_\pi^X$ for the Hilbert798multiplicity space of $V_\pi$ in $H_X$, and likewise $M_\pi^Y$.799Compact harmonic analysis gives the orthogonal decompositions800\[