Update README.md
Browse files
README.md
CHANGED
|
@@ -6923,6 +6923,14 @@ Here are some rules of thumb:
|
|
| 6923 |
|
| 6924 |
Different versions of `transformers` and `pytorch` could cause negligible but non-zero performance differences.
|
| 6925 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 6926 |
## Citation
|
| 6927 |
|
| 6928 |
If you find our paper or models helpful, please consider cite as follows:
|
|
|
|
| 6923 |
|
| 6924 |
Different versions of `transformers` and `pytorch` could cause negligible but non-zero performance differences.
|
| 6925 |
|
| 6926 |
+
**3. Why does the cosine similarity scores distribute around 0.7 to 1.0?**
|
| 6927 |
+
|
| 6928 |
+
This is a known and expected behavior as we use a low temperature 0.01 for InfoNCE contrastive loss.
|
| 6929 |
+
|
| 6930 |
+
For text embedding tasks like text retrieval or semantic similarity,
|
| 6931 |
+
what matters is the relative order of the scores instead of the absolute values,
|
| 6932 |
+
so this should not be an issue.
|
| 6933 |
+
|
| 6934 |
## Citation
|
| 6935 |
|
| 6936 |
If you find our paper or models helpful, please consider cite as follows:
|