Update README.md
Browse files
README.md
CHANGED
|
@@ -114,6 +114,8 @@ def gen_qna(context, question):
|
|
| 114 |
We selected 1000 examples for each of the three tasks in the training dataset, and 100 examples for each task in the validation dataset.
|
| 115 |
This resulted in a total of 3000 examples for training and 300 examples for validation.
|
| 116 |
|
|
|
|
|
|
|
| 117 |
#### Training Hyperparameters
|
| 118 |
|
| 119 |
- **Training regime:** fp16 <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
|
|
|
|
| 114 |
We selected 1000 examples for each of the three tasks in the training dataset, and 100 examples for each task in the validation dataset.
|
| 115 |
This resulted in a total of 3000 examples for training and 300 examples for validation.
|
| 116 |
|
| 117 |
+
The Colab used for training is [here](https://colab.research.google.com/drive/1mwLUNgsSLrRbHUiXJuaU_6EQaYrYg10A?usp=sharing).
|
| 118 |
+
|
| 119 |
#### Training Hyperparameters
|
| 120 |
|
| 121 |
- **Training regime:** fp16 <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
|