Indexed text attachment
partial-differential-equations-in-machine-learning-and-ai.tex
Source for Partial Differential Equations in Machine Learning and AI: Naturality, Well-Posedness, and Spectral Rates
View paper · Download original file
Lines 581–680 of 1085. Source text is displayed literally.
581A continuous normalizing flow \cite{CRBD18} moves samples by $\dot x=v(x,t)$; the density then solves the582continuity equation $\pd_tp+\pd_x(pv)=0$, of which the trajectories are the characteristics583\cite[Prop.~1.8]{PDEHC}.584 585\begin{proposition}\label{prop:cnf}586\Scl[\cite{CRBD18}] Along a trajectory $\frac d{dt}\log p(x(t),t)=-\pd_xv(x(t),t)$.587\end{proposition}588 589\noindent For $v=0.8\tanh(1.3x+0.2)$ the exponential of the integrated divergence equals the derivative of the590flow map to $10^{-8}$. \chk{F1} \term{Flow matching} \cite{LCBNL23,LGL23} chooses a coupling of $X_0\sim p_0$ and591$X_1\sim p_1$, sets $X_t=(1-t)X_0+tX_1$, and regresses onto $v(x,t)=\E[X_1-X_0\mid X_t=x]$.592 593\begin{theorem}[One dimension]\label{thm:fm}594\Sob On the line, if $v$ is regular enough for trajectories to be unique, the flow of the flow-matching field595is the increasing rearrangement of $p_0$ onto $p_1$, whatever the coupling.596\end{theorem}597\begin{proof}598The marginal field transports $p_0$ to $p_1$ by construction. Trajectories of a scalar equation cannot cross,599so the flow map is increasing, and an increasing map carrying one atomless law to another is unique.600\end{proof}601 602\noindent For $p_0=N(0,1)$, $p_1=N(2,\frac14)$ and the independent coupling the field is linear in $x$ with603coefficients rational in $t$, and its flow is $x\mapsto2+\frac12x$ to $10^{-13}$. \chk{F2} The conditional paths604are straight lines that cross; the marginal characteristics do not. In higher dimensions non-crossing no longer605determines the map, and the flow depends on the coupling.606 607\begin{proposition}[A pitchfork in time]\label{prop:pitchfork}608\Sob For $p_0=N(0,1)$ and $p_1$ uniform on $\pm1$, with the independent coupling,609\[ v(x,t)=\frac1{1-t}\Bigl[\tanh\frac{tx}{(1-t)^2}-x\Bigr]. \]610The midpoint $x=0$ is an attracting equilibrium for $t<t^*=\frac{3-\sqrt5}2=0.382$ and a repelling one611afterwards, and $\pd_xv(0,t)\sim(1-t)^{-3}$ as $t\to1$.612\end{proposition}613 614\begin{figure}[t]615\centering616\begin{tikzpicture}617\begin{scope}[shift={(0,0)}]618\draw[ink2] (0,3.8)--(0,0)--(6.3,0);619\draw[ink2] (0,0)--(0,-0.07) node[below,inner sep=1.5pt]{\scriptsize $0$};620\draw[ink2] (3.15,0)--(3.15,-0.07) node[below,inner sep=1.5pt]{\scriptsize $0.5$};621\draw[ink2] (6.3,0)--(6.3,-0.07) node[below,inner sep=1.5pt]{\scriptsize $1$};622\draw[ink2] (0,0.173)--(-0.07,0.173) node[left,inner sep=1.5pt]{\scriptsize $-2$};623\draw[ink2] (0,1.036)--(-0.07,1.036) node[left,inner sep=1.5pt]{\scriptsize $-1$};624\draw[ink2] (0,1.9)--(-0.07,1.9) node[left,inner sep=1.5pt]{\scriptsize $0$};625\draw[ink2] (0,2.764)--(-0.07,2.764) node[left,inner sep=1.5pt]{\scriptsize $1$};626\draw[ink2] (0,3.627)--(-0.07,3.627) node[left,inner sep=1.5pt]{\scriptsize $2$};627\node[below] at (3.15,-0.38) {\scriptsize $t$};628\node[above,inner sep=1pt] at (0,3.85) {\scriptsize $x$};629\draw[accent,densely dashed] (2.406,0)--(2.406,3.8);630\draw[fwd] plot coordinates {(0,0.173) (0.076,0.193) (0.151,0.214) (0.227,0.234) (0.302,0.254) (0.378,0.273) (0.454,0.292) (0.529,0.311) (0.605,0.33) (0.68,0.348) (0.756,0.366) (0.832,0.384) (0.907,0.401) (0.983,0.418) (1.058,0.434) (1.134,0.45) (1.21,0.466) (1.285,0.481) (1.361,0.496) (1.436,0.511) (1.512,0.525) (1.588,0.538) (1.663,0.551) (1.739,0.564) (1.814,0.576) (1.89,0.588) (1.966,0.6) (2.041,0.611) (2.117,0.621) (2.192,0.632) (2.268,0.642) (2.344,0.651) (2.419,0.66) (2.495,0.669) (2.57,0.678) (2.646,0.686) (2.722,0.694) (2.797,0.702) (2.873,0.71) (2.948,0.718) (3.024,0.725) (3.1,0.733) (3.175,0.74) (3.251,0.748) (3.326,0.755) (3.402,0.762) (3.478,0.769) (3.553,0.776) (3.629,0.784) (3.704,0.791) (3.78,0.798) (3.856,0.805) (3.931,0.812) (4.007,0.819) (4.082,0.827) (4.158,0.834) (4.234,0.841) (4.309,0.848) (4.385,0.855) (4.46,0.862) (4.536,0.869) (4.612,0.877) (4.687,0.884) (4.763,0.891) (4.838,0.898) (4.914,0.905) (4.99,0.912) (5.065,0.92) (5.141,0.927) (5.216,0.934) (5.292,0.941) (5.368,0.948) (5.443,0.955) (5.519,0.962) (5.594,0.97) (5.67,0.977) (5.746,0.984) (5.821,0.991) (5.897,0.998) (5.972,1.005) (6.048,1.013) (6.124,1.02)};631\draw[fwd] plot coordinates {(0,0.389) (0.076,0.407) (0.151,0.424) (0.227,0.442) (0.302,0.459) (0.378,0.476) (0.454,0.493) (0.529,0.51) (0.605,0.526) (0.68,0.542) (0.756,0.558) (0.832,0.573) (0.907,0.588) (0.983,0.603) (1.058,0.617) (1.134,0.631) (1.21,0.645) (1.285,0.658) (1.361,0.671) (1.436,0.684) (1.512,0.696) (1.588,0.707) (1.663,0.719) (1.739,0.729) (1.814,0.74) (1.89,0.75) (1.966,0.759) (2.041,0.768) (2.117,0.777) (2.192,0.785) (2.268,0.793) (2.344,0.801) (2.419,0.808) (2.495,0.814) (2.57,0.821) (2.646,0.827) (2.722,0.833) (2.797,0.838) (2.873,0.843) (2.948,0.848) (3.024,0.853) (3.1,0.858) (3.175,0.862) (3.251,0.867) (3.326,0.871) (3.402,0.876) (3.478,0.88) (3.553,0.884) (3.629,0.888) (3.704,0.892) (3.78,0.897) (3.856,0.901) (3.931,0.905) (4.007,0.909) (4.082,0.913) (4.158,0.918) (4.234,0.922) (4.309,0.926) (4.385,0.93) (4.46,0.934) (4.536,0.939) (4.612,0.943) (4.687,0.947) (4.763,0.951) (4.838,0.955) (4.914,0.96) (4.99,0.964) (5.065,0.968) (5.141,0.972) (5.216,0.976) (5.292,0.981) (5.368,0.985) (5.443,0.989) (5.519,0.993) (5.594,0.997) (5.67,1.001) (5.746,1.006) (5.821,1.01) (5.897,1.014) (5.972,1.018) (6.048,1.022) (6.124,1.027)};632\draw[fwd] plot coordinates {(0,0.605) (0.076,0.62) (0.151,0.635) (0.227,0.65) (0.302,0.665) (0.378,0.68) (0.454,0.694) (0.529,0.708) (0.605,0.722) (0.68,0.736) (0.756,0.749) (0.832,0.763) (0.907,0.775) (0.983,0.788) (1.058,0.8) (1.134,0.812) (1.21,0.824) (1.285,0.835) (1.361,0.846) (1.436,0.857) (1.512,0.867) (1.588,0.877) (1.663,0.886) (1.739,0.895) (1.814,0.904) (1.89,0.912) (1.966,0.92) (2.041,0.927) (2.117,0.934) (2.192,0.941) (2.268,0.947) (2.344,0.952) (2.419,0.957) (2.495,0.962) (2.57,0.966) (2.646,0.97) (2.722,0.973) (2.797,0.977) (2.873,0.979) (2.948,0.982) (3.024,0.984) (3.1,0.986) (3.175,0.988) (3.251,0.989) (3.326,0.991) (3.402,0.992) (3.478,0.994) (3.553,0.995) (3.629,0.996) (3.704,0.997) (3.78,0.999) (3.856,1) (3.931,1.001) (4.007,1.002) (4.082,1.003) (4.158,1.004) (4.234,1.005) (4.309,1.006) (4.385,1.008) (4.46,1.009) (4.536,1.01) (4.612,1.011) (4.687,1.012) (4.763,1.013) (4.838,1.014) (4.914,1.016) (4.99,1.017) (5.065,1.018) (5.141,1.019) (5.216,1.02) (5.292,1.021) (5.368,1.022) (5.443,1.024) (5.519,1.025) (5.594,1.026) (5.67,1.027) (5.746,1.028) (5.821,1.029) (5.897,1.03) (5.972,1.031) (6.048,1.033) (6.124,1.034)};633\draw[fwd] plot coordinates {(0,0.82) (0.076,0.833) (0.151,0.846) (0.227,0.859) (0.302,0.871) (0.378,0.883) (0.454,0.895) (0.529,0.907) (0.605,0.919) (0.68,0.93) (0.756,0.941) (0.832,0.952) (0.907,0.963) (0.983,0.973) (1.058,0.984) (1.134,0.993) (1.21,1.003) (1.285,1.012) (1.361,1.022) (1.436,1.03) (1.512,1.039) (1.588,1.047) (1.663,1.055) (1.739,1.062) (1.814,1.069) (1.89,1.075) (1.966,1.082) (2.041,1.087) (2.117,1.092) (2.192,1.097) (2.268,1.102) (2.344,1.106) (2.419,1.109) (2.495,1.112) (2.57,1.114) (2.646,1.116) (2.722,1.118) (2.797,1.119) (2.873,1.119) (2.948,1.119) (3.024,1.119) (3.1,1.119) (3.175,1.118) (3.251,1.117) (3.326,1.115) (3.402,1.114) (3.478,1.112) (3.553,1.11) (3.629,1.109) (3.704,1.107) (3.78,1.105) (3.856,1.103) (3.931,1.101) (4.007,1.099) (4.082,1.097) (4.158,1.095) (4.234,1.092) (4.309,1.09) (4.385,1.088) (4.46,1.086) (4.536,1.084) (4.612,1.082) (4.687,1.08) (4.763,1.078) (4.838,1.076) (4.914,1.074) (4.99,1.072) (5.065,1.07) (5.141,1.068) (5.216,1.066) (5.292,1.064) (5.368,1.062) (5.443,1.06) (5.519,1.058) (5.594,1.056) (5.67,1.053) (5.746,1.051) (5.821,1.049) (5.897,1.047) (5.972,1.045) (6.048,1.043) (6.124,1.041)};634\draw[fwd] plot coordinates {(0,1.036) (0.076,1.047) (0.151,1.057) (0.227,1.067) (0.302,1.077) (0.378,1.087) (0.454,1.096) (0.529,1.106) (0.605,1.115) (0.68,1.124) (0.756,1.133) (0.832,1.142) (0.907,1.15) (0.983,1.159) (1.058,1.167) (1.134,1.175) (1.21,1.182) (1.285,1.19) (1.361,1.197) (1.436,1.204) (1.512,1.211) (1.588,1.217) (1.663,1.223) (1.739,1.229) (1.814,1.234) (1.89,1.239) (1.966,1.244) (2.041,1.248) (2.117,1.252) (2.192,1.256) (2.268,1.258) (2.344,1.261) (2.419,1.263) (2.495,1.265) (2.57,1.265) (2.646,1.266) (2.722,1.266) (2.797,1.265) (2.873,1.264) (2.948,1.262) (3.024,1.26) (3.1,1.257) (3.175,1.254) (3.251,1.251) (3.326,1.247) (3.402,1.242) (3.478,1.238) (3.553,1.233) (3.629,1.228) (3.704,1.223) (3.78,1.217) (3.856,1.212) (3.931,1.207) (4.007,1.201) (4.082,1.196) (4.158,1.19) (4.234,1.185) (4.309,1.18) (4.385,1.174) (4.46,1.169) (4.536,1.163) (4.612,1.158) (4.687,1.152) (4.763,1.147) (4.838,1.142) (4.914,1.136) (4.99,1.131) (5.065,1.125) (5.141,1.12) (5.216,1.114) (5.292,1.109) (5.368,1.103) (5.443,1.098) (5.519,1.093) (5.594,1.087) (5.67,1.082) (5.746,1.076) (5.821,1.071) (5.897,1.065) (5.972,1.06) (6.048,1.054) (6.124,1.049)};635\draw[fwd] plot coordinates {(0,1.252) (0.076,1.26) (0.151,1.268) (0.227,1.275) (0.302,1.283) (0.378,1.29) (0.454,1.297) (0.529,1.304) (0.605,1.311) (0.68,1.318) (0.756,1.325) (0.832,1.331) (0.907,1.338) (0.983,1.344) (1.058,1.35) (1.134,1.356) (1.21,1.362) (1.285,1.367) (1.361,1.373) (1.436,1.378) (1.512,1.383) (1.588,1.388) (1.663,1.392) (1.739,1.396) (1.814,1.4) (1.89,1.404) (1.966,1.407) (2.041,1.41) (2.117,1.413) (2.192,1.415) (2.268,1.417) (2.344,1.419) (2.419,1.42) (2.495,1.42) (2.57,1.42) (2.646,1.42) (2.722,1.418) (2.797,1.417) (2.873,1.414) (2.948,1.412) (3.024,1.408) (3.1,1.404) (3.175,1.399) (3.251,1.393) (3.326,1.387) (3.402,1.38) (3.478,1.373) (3.553,1.366) (3.629,1.357) (3.704,1.349) (3.78,1.34) (3.856,1.332) (3.931,1.323) (4.007,1.314) (4.082,1.305) (4.158,1.295) (4.234,1.286) (4.309,1.277) (4.385,1.268) (4.46,1.259) (4.536,1.25) (4.612,1.241) (4.687,1.231) (4.763,1.222) (4.838,1.213) (4.914,1.204) (4.99,1.195) (5.065,1.186) (5.141,1.177) (5.216,1.167) (5.292,1.158) (5.368,1.149) (5.443,1.14) (5.519,1.131) (5.594,1.122) (5.67,1.113) (5.746,1.103) (5.821,1.094) (5.897,1.085) (5.972,1.076) (6.048,1.067) (6.124,1.058)};636\draw[fwd] plot coordinates {(0,1.468) (0.076,1.473) (0.151,1.478) (0.227,1.483) (0.302,1.488) (0.378,1.493) (0.454,1.498) (0.529,1.503) (0.605,1.507) (0.68,1.512) (0.756,1.516) (0.832,1.521) (0.907,1.525) (0.983,1.529) (1.058,1.533) (1.134,1.537) (1.21,1.541) (1.285,1.545) (1.361,1.548) (1.436,1.552) (1.512,1.555) (1.588,1.558) (1.663,1.561) (1.739,1.564) (1.814,1.567) (1.89,1.569) (1.966,1.571) (2.041,1.573) (2.117,1.575) (2.192,1.576) (2.268,1.577) (2.344,1.578) (2.419,1.578) (2.495,1.578) (2.57,1.578) (2.646,1.577) (2.722,1.576) (2.797,1.574) (2.873,1.571) (2.948,1.568) (3.024,1.564) (3.1,1.56) (3.175,1.554) (3.251,1.548) (3.326,1.541) (3.402,1.533) (3.478,1.525) (3.553,1.515) (3.629,1.505) (3.704,1.493) (3.78,1.482) (3.856,1.469) (3.931,1.457) (4.007,1.444) (4.082,1.431) (4.158,1.417) (4.234,1.404) (4.309,1.391) (4.385,1.377) (4.46,1.364) (4.536,1.35) (4.612,1.337) (4.687,1.323) (4.763,1.31) (4.838,1.296) (4.914,1.283) (4.99,1.269) (5.065,1.256) (5.141,1.243) (5.216,1.229) (5.292,1.216) (5.368,1.202) (5.443,1.189) (5.519,1.175) (5.594,1.162) (5.67,1.148) (5.746,1.135) (5.821,1.122) (5.897,1.108) (5.972,1.095) (6.048,1.081) (6.124,1.068)};637\draw[fwd] plot coordinates {(0,1.684) (0.076,1.687) (0.151,1.689) (0.227,1.692) (0.302,1.694) (0.378,1.697) (0.454,1.699) (0.529,1.701) (0.605,1.704) (0.68,1.706) (0.756,1.708) (0.832,1.71) (0.907,1.713) (0.983,1.715) (1.058,1.717) (1.134,1.719) (1.21,1.721) (1.285,1.722) (1.361,1.724) (1.436,1.726) (1.512,1.728) (1.588,1.729) (1.663,1.731) (1.739,1.732) (1.814,1.733) (1.89,1.734) (1.966,1.735) (2.041,1.736) (2.117,1.737) (2.192,1.738) (2.268,1.738) (2.344,1.739) (2.419,1.739) (2.495,1.739) (2.57,1.738) (2.646,1.738) (2.722,1.737) (2.797,1.735) (2.873,1.734) (2.948,1.732) (3.024,1.729) (3.1,1.726) (3.175,1.722) (3.251,1.718) (3.326,1.713) (3.402,1.707) (3.478,1.7) (3.553,1.691) (3.629,1.682) (3.704,1.671) (3.78,1.659) (3.856,1.645) (3.931,1.63) (4.007,1.614) (4.082,1.597) (4.158,1.579) (4.234,1.56) (4.309,1.541) (4.385,1.522) (4.46,1.503) (4.536,1.484) (4.612,1.465) (4.687,1.446) (4.763,1.426) (4.838,1.407) (4.914,1.388) (4.99,1.369) (5.065,1.35) (5.141,1.33) (5.216,1.311) (5.292,1.292) (5.368,1.273) (5.443,1.254) (5.519,1.235) (5.594,1.215) (5.67,1.196) (5.746,1.177) (5.821,1.158) (5.897,1.139) (5.972,1.119) (6.048,1.1) (6.124,1.081)};638\draw[bwd,densely dotted] plot coordinates {(0,1.9) (0.076,1.9) (0.151,1.9) (0.227,1.9) (0.302,1.9) (0.378,1.9) (0.454,1.9) (0.529,1.9) (0.605,1.9) (0.68,1.9) (0.756,1.9) (0.832,1.9) (0.907,1.9) (0.983,1.9) (1.058,1.9) (1.134,1.9) (1.21,1.9) (1.285,1.9) (1.361,1.9) (1.436,1.9) (1.512,1.9) (1.588,1.9) (1.663,1.9) (1.739,1.9) (1.814,1.9) (1.89,1.9) (1.966,1.9) (2.041,1.9) (2.117,1.9) (2.192,1.9) (2.268,1.9) (2.344,1.9) (2.419,1.9) (2.495,1.9) (2.57,1.9) (2.646,1.9) (2.722,1.9) (2.797,1.9) (2.873,1.9) (2.948,1.9) (3.024,1.9) (3.1,1.9) (3.175,1.9) (3.251,1.9) (3.326,1.9) (3.402,1.9) (3.478,1.9) (3.553,1.9) (3.629,1.9) (3.704,1.9) (3.78,1.9) (3.856,1.9) (3.931,1.9) (4.007,1.9) (4.082,1.9) (4.158,1.9) (4.234,1.9) (4.309,1.9) (4.385,1.9) (4.46,1.9) (4.536,1.9) (4.612,1.9) (4.687,1.9) (4.763,1.9) (4.838,1.9) (4.914,1.9) (4.99,1.9) (5.065,1.9) (5.141,1.9) (5.216,1.9) (5.292,1.9) (5.368,1.9) (5.443,1.9) (5.519,1.9) (5.594,1.9) (5.67,1.9) (5.746,1.9) (5.821,1.9) (5.897,1.9) (5.972,1.9) (6.048,1.9) (6.124,1.9)};639\draw[fwd] plot coordinates {(0,2.116) (0.076,2.113) (0.151,2.111) (0.227,2.108) (0.302,2.106) (0.378,2.103) (0.454,2.101) (0.529,2.099) (0.605,2.096) (0.68,2.094) (0.756,2.092) (0.832,2.09) (0.907,2.087) (0.983,2.085) (1.058,2.083) (1.134,2.081) (1.21,2.079) (1.285,2.078) (1.361,2.076) (1.436,2.074) (1.512,2.072) (1.588,2.071) (1.663,2.069) (1.739,2.068) (1.814,2.067) (1.89,2.066) (1.966,2.065) (2.041,2.064) (2.117,2.063) (2.192,2.062) (2.268,2.062) (2.344,2.061) (2.419,2.061) (2.495,2.061) (2.57,2.062) (2.646,2.062) (2.722,2.063) (2.797,2.065) (2.873,2.066) (2.948,2.068) (3.024,2.071) (3.1,2.074) (3.175,2.078) (3.251,2.082) (3.326,2.087) (3.402,2.093) (3.478,2.1) (3.553,2.109) (3.629,2.118) (3.704,2.129) (3.78,2.141) (3.856,2.155) (3.931,2.17) (4.007,2.186) (4.082,2.203) (4.158,2.221) (4.234,2.24) (4.309,2.259) (4.385,2.278) (4.46,2.297) (4.536,2.316) (4.612,2.335) (4.687,2.354) (4.763,2.374) (4.838,2.393) (4.914,2.412) (4.99,2.431) (5.065,2.45) (5.141,2.47) (5.216,2.489) (5.292,2.508) (5.368,2.527) (5.443,2.546) (5.519,2.565) (5.594,2.585) (5.67,2.604) (5.746,2.623) (5.821,2.642) (5.897,2.661) (5.972,2.681) (6.048,2.7) (6.124,2.719)};640\draw[fwd] plot coordinates {(0,2.332) (0.076,2.327) (0.151,2.322) (0.227,2.317) (0.302,2.312) (0.378,2.307) (0.454,2.302) (0.529,2.297) (0.605,2.293) (0.68,2.288) (0.756,2.284) (0.832,2.279) (0.907,2.275) (0.983,2.271) (1.058,2.267) (1.134,2.263) (1.21,2.259) (1.285,2.255) (1.361,2.252) (1.436,2.248) (1.512,2.245) (1.588,2.242) (1.663,2.239) (1.739,2.236) (1.814,2.233) (1.89,2.231) (1.966,2.229) (2.041,2.227) (2.117,2.225) (2.192,2.224) (2.268,2.223) (2.344,2.222) (2.419,2.222) (2.495,2.222) (2.57,2.222) (2.646,2.223) (2.722,2.224) (2.797,2.226) (2.873,2.229) (2.948,2.232) (3.024,2.236) (3.1,2.24) (3.175,2.246) (3.251,2.252) (3.326,2.259) (3.402,2.267) (3.478,2.275) (3.553,2.285) (3.629,2.295) (3.704,2.307) (3.78,2.318) (3.856,2.331) (3.931,2.343) (4.007,2.356) (4.082,2.369) (4.158,2.383) (4.234,2.396) (4.309,2.409) (4.385,2.423) (4.46,2.436) (4.536,2.45) (4.612,2.463) (4.687,2.477) (4.763,2.49) (4.838,2.504) (4.914,2.517) (4.99,2.531) (5.065,2.544) (5.141,2.557) (5.216,2.571) (5.292,2.584) (5.368,2.598) (5.443,2.611) (5.519,2.625) (5.594,2.638) (5.67,2.652) (5.746,2.665) (5.821,2.678) (5.897,2.692) (5.972,2.705) (6.048,2.719) (6.124,2.732)};641\draw[fwd] plot coordinates {(0,2.548) (0.076,2.54) (0.151,2.532) (0.227,2.525) (0.302,2.517) (0.378,2.51) (0.454,2.503) (0.529,2.496) (0.605,2.489) (0.68,2.482) (0.756,2.475) (0.832,2.469) (0.907,2.462) (0.983,2.456) (1.058,2.45) (1.134,2.444) (1.21,2.438) (1.285,2.433) (1.361,2.427) (1.436,2.422) (1.512,2.417) (1.588,2.412) (1.663,2.408) (1.739,2.404) (1.814,2.4) (1.89,2.396) (1.966,2.393) (2.041,2.39) (2.117,2.387) (2.192,2.385) (2.268,2.383) (2.344,2.381) (2.419,2.38) (2.495,2.38) (2.57,2.38) (2.646,2.38) (2.722,2.382) (2.797,2.383) (2.873,2.386) (2.948,2.388) (3.024,2.392) (3.1,2.396) (3.175,2.401) (3.251,2.407) (3.326,2.413) (3.402,2.42) (3.478,2.427) (3.553,2.434) (3.629,2.443) (3.704,2.451) (3.78,2.46) (3.856,2.468) (3.931,2.477) (4.007,2.486) (4.082,2.495) (4.158,2.505) (4.234,2.514) (4.309,2.523) (4.385,2.532) (4.46,2.541) (4.536,2.55) (4.612,2.559) (4.687,2.569) (4.763,2.578) (4.838,2.587) (4.914,2.596) (4.99,2.605) (5.065,2.614) (5.141,2.623) (5.216,2.633) (5.292,2.642) (5.368,2.651) (5.443,2.66) (5.519,2.669) (5.594,2.678) (5.67,2.687) (5.746,2.697) (5.821,2.706) (5.897,2.715) (5.972,2.724) (6.048,2.733) (6.124,2.742)};642\draw[fwd] plot coordinates {(0,2.764) (0.076,2.753) (0.151,2.743) (0.227,2.733) (0.302,2.723) (0.378,2.713) (0.454,2.704) (0.529,2.694) (0.605,2.685) (0.68,2.676) (0.756,2.667) (0.832,2.658) (0.907,2.65) (0.983,2.641) (1.058,2.633) (1.134,2.625) (1.21,2.618) (1.285,2.61) (1.361,2.603) (1.436,2.596) (1.512,2.589) (1.588,2.583) (1.663,2.577) (1.739,2.571) (1.814,2.566) (1.89,2.561) (1.966,2.556) (2.041,2.552) (2.117,2.548) (2.192,2.544) (2.268,2.542) (2.344,2.539) (2.419,2.537) (2.495,2.535) (2.57,2.535) (2.646,2.534) (2.722,2.534) (2.797,2.535) (2.873,2.536) (2.948,2.538) (3.024,2.54) (3.1,2.543) (3.175,2.546) (3.251,2.549) (3.326,2.553) (3.402,2.558) (3.478,2.562) (3.553,2.567) (3.629,2.572) (3.704,2.577) (3.78,2.583) (3.856,2.588) (3.931,2.593) (4.007,2.599) (4.082,2.604) (4.158,2.61) (4.234,2.615) (4.309,2.62) (4.385,2.626) (4.46,2.631) (4.536,2.637) (4.612,2.642) (4.687,2.648) (4.763,2.653) (4.838,2.658) (4.914,2.664) (4.99,2.669) (5.065,2.675) (5.141,2.68) (5.216,2.686) (5.292,2.691) (5.368,2.697) (5.443,2.702) (5.519,2.707) (5.594,2.713) (5.67,2.718) (5.746,2.724) (5.821,2.729) (5.897,2.735) (5.972,2.74) (6.048,2.746) (6.124,2.751)};643\draw[fwd] plot coordinates {(0,2.98) (0.076,2.967) (0.151,2.954) (0.227,2.941) (0.302,2.929) (0.378,2.917) (0.454,2.905) (0.529,2.893) (0.605,2.881) (0.68,2.87) (0.756,2.859) (0.832,2.848) (0.907,2.837) (0.983,2.827) (1.058,2.816) (1.134,2.807) (1.21,2.797) (1.285,2.788) (1.361,2.778) (1.436,2.77) (1.512,2.761) (1.588,2.753) (1.663,2.745) (1.739,2.738) (1.814,2.731) (1.89,2.725) (1.966,2.718) (2.041,2.713) (2.117,2.708) (2.192,2.703) (2.268,2.698) (2.344,2.694) (2.419,2.691) (2.495,2.688) (2.57,2.686) (2.646,2.684) (2.722,2.682) (2.797,2.681) (2.873,2.681) (2.948,2.681) (3.024,2.681) (3.1,2.681) (3.175,2.682) (3.251,2.683) (3.326,2.685) (3.402,2.686) (3.478,2.688) (3.553,2.69) (3.629,2.691) (3.704,2.693) (3.78,2.695) (3.856,2.697) (3.931,2.699) (4.007,2.701) (4.082,2.703) (4.158,2.705) (4.234,2.708) (4.309,2.71) (4.385,2.712) (4.46,2.714) (4.536,2.716) (4.612,2.718) (4.687,2.72) (4.763,2.722) (4.838,2.724) (4.914,2.726) (4.99,2.728) (5.065,2.73) (5.141,2.732) (5.216,2.734) (5.292,2.736) (5.368,2.738) (5.443,2.74) (5.519,2.742) (5.594,2.744) (5.67,2.747) (5.746,2.749) (5.821,2.751) (5.897,2.753) (5.972,2.755) (6.048,2.757) (6.124,2.759)};644\draw[fwd] plot coordinates {(0,3.195) (0.076,3.18) (0.151,3.165) (0.227,3.15) (0.302,3.135) (0.378,3.12) (0.454,3.106) (0.529,3.092) (0.605,3.078) (0.68,3.064) (0.756,3.051) (0.832,3.037) (0.907,3.025) (0.983,3.012) (1.058,3) (1.134,2.988) (1.21,2.976) (1.285,2.965) (1.361,2.954) (1.436,2.943) (1.512,2.933) (1.588,2.923) (1.663,2.914) (1.739,2.905) (1.814,2.896) (1.89,2.888) (1.966,2.88) (2.041,2.873) (2.117,2.866) (2.192,2.859) (2.268,2.853) (2.344,2.848) (2.419,2.843) (2.495,2.838) (2.57,2.834) (2.646,2.83) (2.722,2.827) (2.797,2.823) (2.873,2.821) (2.948,2.818) (3.024,2.816) (3.1,2.814) (3.175,2.812) (3.251,2.811) (3.326,2.809) (3.402,2.808) (3.478,2.806) (3.553,2.805) (3.629,2.804) (3.704,2.803) (3.78,2.801) (3.856,2.8) (3.931,2.799) (4.007,2.798) (4.082,2.797) (4.158,2.796) (4.234,2.795) (4.309,2.794) (4.385,2.792) (4.46,2.791) (4.536,2.79) (4.612,2.789) (4.687,2.788) (4.763,2.787) (4.838,2.786) (4.914,2.784) (4.99,2.783) (5.065,2.782) (5.141,2.781) (5.216,2.78) (5.292,2.779) (5.368,2.778) (5.443,2.776) (5.519,2.775) (5.594,2.774) (5.67,2.773) (5.746,2.772) (5.821,2.771) (5.897,2.77) (5.972,2.769) (6.048,2.767) (6.124,2.766)};645\draw[fwd] plot coordinates {(0,3.411) (0.076,3.393) (0.151,3.376) (0.227,3.358) (0.302,3.341) (0.378,3.324) (0.454,3.307) (0.529,3.29) (0.605,3.274) (0.68,3.258) (0.756,3.242) (0.832,3.227) (0.907,3.212) (0.983,3.197) (1.058,3.183) (1.134,3.169) (1.21,3.155) (1.285,3.142) (1.361,3.129) (1.436,3.116) (1.512,3.104) (1.588,3.093) (1.663,3.081) (1.739,3.071) (1.814,3.06) (1.89,3.05) (1.966,3.041) (2.041,3.032) (2.117,3.023) (2.192,3.015) (2.268,3.007) (2.344,2.999) (2.419,2.992) (2.495,2.986) (2.57,2.979) (2.646,2.973) (2.722,2.967) (2.797,2.962) (2.873,2.957) (2.948,2.952) (3.024,2.947) (3.1,2.942) (3.175,2.938) (3.251,2.933) (3.326,2.929) (3.402,2.924) (3.478,2.92) (3.553,2.916) (3.629,2.912) (3.704,2.908) (3.78,2.903) (3.856,2.899) (3.931,2.895) (4.007,2.891) (4.082,2.887) (4.158,2.882) (4.234,2.878) (4.309,2.874) (4.385,2.87) (4.46,2.866) (4.536,2.861) (4.612,2.857) (4.687,2.853) (4.763,2.849) (4.838,2.845) (4.914,2.84) (4.99,2.836) (5.065,2.832) (5.141,2.828) (5.216,2.824) (5.292,2.819) (5.368,2.815) (5.443,2.811) (5.519,2.807) (5.594,2.803) (5.67,2.799) (5.746,2.794) (5.821,2.79) (5.897,2.786) (5.972,2.782) (6.048,2.778) (6.124,2.773)};646\draw[fwd] plot coordinates {(0,3.627) (0.076,3.607) (0.151,3.586) (0.227,3.566) (0.302,3.546) (0.378,3.527) (0.454,3.508) (0.529,3.489) (0.605,3.47) (0.68,3.452) (0.756,3.434) (0.832,3.416) (0.907,3.399) (0.983,3.382) (1.058,3.366) (1.134,3.35) (1.21,3.334) (1.285,3.319) (1.361,3.304) (1.436,3.289) (1.512,3.275) (1.588,3.262) (1.663,3.249) (1.739,3.236) (1.814,3.224) (1.89,3.212) (1.966,3.2) (2.041,3.189) (2.117,3.179) (2.192,3.168) (2.268,3.158) (2.344,3.149) (2.419,3.14) (2.495,3.131) (2.57,3.122) (2.646,3.114) (2.722,3.106) (2.797,3.098) (2.873,3.09) (2.948,3.082) (3.024,3.075) (3.1,3.067) (3.175,3.06) (3.251,3.052) (3.326,3.045) (3.402,3.038) (3.478,3.031) (3.553,3.024) (3.629,3.016) (3.704,3.009) (3.78,3.002) (3.856,2.995) (3.931,2.988) (4.007,2.981) (4.082,2.973) (4.158,2.966) (4.234,2.959) (4.309,2.952) (4.385,2.945) (4.46,2.938) (4.536,2.931) (4.612,2.923) (4.687,2.916) (4.763,2.909) (4.838,2.902) (4.914,2.895) (4.99,2.888) (5.065,2.88) (5.141,2.873) (5.216,2.866) (5.292,2.859) (5.368,2.852) (5.443,2.845) (5.519,2.838) (5.594,2.83) (5.67,2.823) (5.746,2.816) (5.821,2.809) (5.897,2.802) (5.972,2.795) (6.048,2.787) (6.124,2.78)};647\fill[black] (6.3,2.764) circle (1.8pt);648\fill[black] (6.3,1.036) circle (1.8pt);649\node[accent] at (2.406,4.016) {\scriptsize $t^*$};650\end{scope}651\end{tikzpicture}652\caption{Characteristics of the flow-matching field from $N(0,1)$ to the two points $\pm1$ (\cref{prop:pitchfork}). The midpoint is attracting until $t^*=0.382$ and repelling afterwards; the dotted line is the unstable trajectory. No two characteristics cross.}\label{fig:pitchfork}653\end{figure}654 655\noindent The field satisfies the continuity equation with $p_t$ to $10^{-13}$; the slope at the midpoint changes656sign at $0.381966$ and is $890$ at $t=0.9$ (\cref{fig:pitchfork}). \chk{F3} This is the transport-side picture of657\cref{thm:illposed}(c): mass begins to be committed to one of the two points at a definite time $t^*$, by the bifurcation658that \cite[Thm.~14.7]{PDEHC} describes for a buckling rod, and the field then steepens without bound as the659characteristics focus. Such transition times have been studied for diffusion models in high dimension660\cite{BBDM24}.661 662\section{Graph networks}\label{sec:graphs}663 664Let $L$ be the Laplacian of a connected graph with eigenvalues $0=\lambda_1<\lambda_2\le\dots\le\lambda_n$. The665linear part of a message-passing layer is $X\mapsto(I-\tau L)X$, one explicit Euler step of the heat equation on666the graph \cite{CRGBB21}.667 668\begin{theorem}[Oversmoothing is the spectral gap]\label{thm:oversmooth}669\Scl[\cite{LHW18,OoSu20}] For $0<\tau\le1/\lambda_n$ the non-constant part of $X$ is multiplied by at most670$1-\tau\lambda_2$ per layer, with equality in the limit, and the Dirichlet energy $X^{\T}LX$ by at most671$(1-\tau\lambda_2)^2$. The depth at which features become indistinguishable is of order $1/\tau\lambda_2$.672\end{theorem}673 674\noindent On a random connected graph with $12$ nodes, $\lambda_2=0.6251$, $\lambda_n=8.2655$ and the measured675factor is $0.92437$, as predicted; $99\%$ of the Dirichlet energy of a random input is gone after $15$ layers,676the bound from $\lambda_2$ alone being $29$. \chk{G1} The depth scale varies by orders of magnitude with the677graph: on $32$ nodes, with $\tau$ at its largest stable value, it is $415$ layers for a path678($\lambda_2=0.00963$), $5$ for the hypercube ($\lambda_2=2$, $\lambda_n=10$) and $1$ for the complete graph,679where a single layer returns the mean exactly (\cref{fig:smooth}). \chk{G2} Graphs that are good for propagating information are680the ones that oversmooth fastest; the two are the same eigenvalue.