llms got good at text and stayed bad at tables. i don’t think "less training data" is the reason
give a model a paragraph and it does fine. give it a column called ref_4 holding 11 character strings and it has nothing. not less signal, nothing. the values are opaque by design and the column name was an abbreviation someone stopped explaining in 20…