Tokenizer Study
Collection
Models comparing the effects of tokenizer properties on pre-training compression, and its relationship with downstream performance.
•
84 items
•
Updated
•
3
No model card