When Can You Correct Distribution Drift in Temporal Graph Generation? A Sharpening--Drift Tension and an Impossibility for Observation-Based Correction
2026-07-27 • Machine Learning
Machine LearningSocial and Information Networks
AI summaryⓘ
The authors studied why generative models predicting changes in networks perform poorly when applied to future data. They show that this drop in accuracy is a fundamental problem caused by rare patterns not seen during training and cannot be fixed just by looking at past data. Their math proves that trying to correct the model using only past observations leaves unavoidable uncertainty, and simple prediction methods often do worse than doing nothing. Even an ideal corrector can only reduce some of the error, highlighting intrinsic limits in these models' adaptability over time.
generative modelstemporal graphsmasked flow-matching lossentropydistribution shiftdriftconditional variancetrend extrapolationinnovationerror floor
Authors
Tianpeng Li, Xuan Guo, Wenjun Wang, Wang Zhang, Pengfei Jiao
Abstract
Generative models of temporal graphs are trained on one stretch of an evolving network and deployed on the next, and they degrade badly in the gap. We show this degradation is derivable, general, and not fixable from observations. The masked flow-matching loss decomposes exactly, with no independence assumption, into an irreducible entropy plus a divergence whose derivative along the training path is positive precisely for structures rare during training and common at deployment, diverging as their training probability goes to zero. Empirically the trade-off is a power law with exponent $-0.605$ ($R^2=0.9977$), and drift raises the sampler's error floor without changing how many steps reach it: across seven well-powered conditions the drift-period marginal error varies by at most $6\%$ over a $50\times$ range of sampling budgets, while the floor sits $2.2\times$ to $34.3\times$ above the in-period floor. Because the deployment period is observed, correction looks like a matter of measurement. It is not. We prove that any corrector measurable with respect to past observations leaves at least the conditional variance of the statistic it tracks, and that trend extrapolation beats trusting the last observation only when $μ^2>v(1-2ρ)$. Both premises are measurable and both go the wrong way: the drift is trendless and mean-reverting, with a one-step innovation as large as the drift itself. An oracle removes $60\%$ of the error, the best observation-based corrector recovers $5.7\%$ of that, and extrapolation is strictly worse than doing nothing clever.