Spaces:

alibayram
/

turkish_tiktokenizer

Running

App Files Files Community

turkish_tiktokenizer

11.9 kB

1 contributor

History: 16 commits

alibayram's picture

Update requirements.txt

da42085 verified about 2 months ago

.gitattributes

1.52 kB

initial commit 9 months ago
.gitignore

15 Bytes

Update REQUIRED_FILES to reference kokler_v07.json instead of kokler_v05.json 8 months ago
README.md

3.26 kB

Enhance README with a new section detailing the research paper on the hybrid tokenization approach, including citation information and authors. Update requirements to specify the version of the Turkish Tokenizer package. 2 months ago
app.py

7.06 kB

Add version retrieval for Turkish Tokenizer package and update footer in Gradio interface to display version number. 3 months ago
requirements.txt

33 Bytes

Update requirements.txt about 2 months ago