whitphx's picture
whitphx HF Staff
Warm/Cold tests, repeated tests
b4867cc
|
raw
history blame
467 Bytes

bench-node (warm/cold, repeats, p50/p90)

Setup

cd bench-node
npm i

Run examples

# Warm: prefetch once (not measured) -> measure 5 times
npm run bench -- Xenova/distilbert-base-uncased feature-extraction --mode warm --repeats 5 --cache-dir .bench-cache/warm

# Cold: delete cache before each run, measure 3 times
npm run bench -- Xenova/distilbert-base-uncased feature-extraction --mode cold --repeats 3 --cache-dir .bench-cache/cold