Update inference/README.md
Browse files- inference/README.md +1 -1
inference/README.md
CHANGED
|
@@ -9,5 +9,5 @@ python convert.py --hf-ckpt-path ${HF_CKPT_PATH} --save-path ${SAVE_PATH} --n-ex
|
|
| 9 |
Then chat with DeepSeek model at will!
|
| 10 |
```bash
|
| 11 |
export CONFIG=config_671B_v3.1.json
|
| 12 |
-
torchrun --nproc-per-node ${MP} generate.py --ckpt-path ${SAVE_PATH} --config ${CONFIG} --interactive
|
| 13 |
```
|
|
|
|
| 9 |
Then chat with DeepSeek model at will!
|
| 10 |
```bash
|
| 11 |
export CONFIG=config_671B_v3.1.json
|
| 12 |
+
torchrun --nproc-per-node ${MP} generate.py --ckpt-path ${SAVE_PATH} --config ${CONFIG} --interactive
|
| 13 |
```
|