Notes
- Telasian Labs
The closing window for public benchmarks
Twelve months out, the existing public benchmark suite will be fully saturated by every frontier model. The next generation of evaluations is going to look completely different. It is not going to be cheap.
- Telasian Labs
The data substrate is where alignment actually happens
The alignment conversation centers on post-training: RLHF, constitutional methods, refusal training. The base model already knows what it knows. Alignment is mostly choosing which of those things to emphasize.
- Telasian Labs
What a benchmark cannot tell you
Saturation on a benchmark does not mean the capability surface is mapped. The gap between the published evaluations and the real cognitive frontier is widening, and the field is optimizing for the proxy.