Microscale
0
← back to the atlas
Act V · Region 05

Where They Break

The honesty wing of the museum

SLMs hallucinate, mis-reason, lose track of long contexts, forget general skills under fine-tuning. Every failure mode gets a mechanism, not an excuse.

badge · Skeptic
0 of 4 lessons completed
  1. 1
    The emergence cliff
    Scrub the parameter slider, see capabilities pop
  2. 2
    Chain-of-thought regression
    Small models write fluent nonsense
  3. 3
    Hallucination is inevitable
    The Kalai / Xu argument, interactive
  4. 4
    Lost in the middle
    A needle, and 100k tokens of haystack