TabPFN and TabICL vs. tuned XGBoost: the model that doesn't train won 14/14

What happened
The claim behind TabPFN and TabICL is that they predict on a table without ever training on it and still beat tuned boosting.
Summary assembled by rule from the sources below