Date Fragments: Tokenization Bottleneck Limits Temporal Reasoning
DateAugBench provides ~6,500 examples for date resolution. Researchers find BPE tokenizers split dates (e.g., 20250312 → 202 503 12), causing a 10‑point accuracy drop on dates. getnews.me/date-fragments-tokenizat... #datetokenization #temporalreasoning
0
0
0
0