cahya
/

nusa-tokenizer

Model card Files Files and versions

Commit History

set max sec length to 8192

1b125c4

libeanim commited on Feb 7

Upload tokenizer

69e852e
verified

cahya commited on Feb 4

Upload tokenizer

065eb75
verified

cahya commited on Feb 4

Upload tokenizer

1124493
verified

cahya commited on Feb 4

Upload tokenizer

ff9010d
verified

cahya commited on Feb 4

Upload tokenizer

989c7ab
verified

cahya commited on Feb 4

initial commit

3c5cd1e
verified

cahya commited on Feb 4