huggingface/data-measurements-tool at 66693d5c26415e9c7d9b3e00ecd1da07778828d5

data-measurements-tool / data_measurements

111 kB

14 contributors

meg-huggingface

Removing need to keep around base dset for the header widget; now just saving what is shown -- the first n lines of the base dataset -- as a json, and loading if it's cached.

66693d5 almost 4 years ago

__init__.py

0 Bytes

:tada: init about 4 years ago
dataset_statistics.py

44.7 kB

Removing need to keep around base dset for the header widget; now just saving what is shown -- the first n lines of the base dataset -- as a json, and loading if it's cached. almost 4 years ago
dataset_utils.py

9.76 kB

Removing any need for a dataframe in expander_general_stats; instead making sure to cache and load the small amount of details needed for this widget. Note I also moved around a couple functions -- same content, just moved -- so that it was easier for me to navigate through the code. I also pulled out a couple of sub-functions from larger functions, again to make the code easier to work with/understand, as well as helping to further modularize so we can limit what needs to be cached. about 4 years ago
embeddings.py

16.3 kB

:tada: init about 4 years ago
npmi.py

10.5 kB

:bug: really make sure log_files/ exists about 4 years ago
streamlit_utils.py

20.4 kB

Removing need to keep around base dset for the header widget; now just saving what is shown -- the first n lines of the base dataset -- as a json, and loading if it's cached. almost 4 years ago
zipf.py

8.86 kB

:bug: really make sure log_files/ exists about 4 years ago