atlasia
/

darija_bpe_tokenizer

Model card Files Files and versions

darija_bpe_tokenizer / config.json

Afaf's picture

Upload darija BPE tokenizer config file

63fb4f0 verified 3 months ago

history blame contribute delete

96 Bytes

	{
	"model_type": "gpt2",
	"tokenizer_class": "PreTrainedTokenizerFast",
	"vocab_size": null
	}