Spaces:
Runtime error
Runtime error
Commit
·
2931d01
1
Parent(s):
4871c6f
Update intro
Browse files- sections/intro/intro.md +1 -1
sections/intro/intro.md
CHANGED
|
@@ -7,7 +7,7 @@ In addition, even recent **approaches that have been proposed for VQA generally
|
|
| 7 |
- the the boxes are selected using a NMS (Non-max suppression),
|
| 8 |
- and then the features for selected boxes are used as visual features.
|
| 9 |
|
| 10 |
-
A major **advantage that comes from using transformers is their simplicity and their accessibility** - thanks to HuggingFace
|
| 11 |
|
| 12 |
While building a low-resource non-English VQA approach has several benefits of its own, a multilingual VQA task is interesting because it will help create a generic approach/model that works decently well across several languages **With the aim of democratizing such a challenging yet interesting task, in this project, we focus on Mutilingual Visual Question Answering (MVQA)**. Our intention here is to provide a Proof-of-Concept with our simple CLIP-Vision-BERT baseline which leverages a multilingual checkpoint with pre-trained image encoders. Our model currently supports for four languages - **English, French, German and Spanish**.
|
| 13 |
|
|
|
|
| 7 |
- the the boxes are selected using a NMS (Non-max suppression),
|
| 8 |
- and then the features for selected boxes are used as visual features.
|
| 9 |
|
| 10 |
+
A major **advantage that comes from using transformers is their simplicity and their accessibility** - thanks to HuggingFace, ViT and Transformers. For ViT models, for example, all one needs to do is pass the normalized images to the transformer.
|
| 11 |
|
| 12 |
While building a low-resource non-English VQA approach has several benefits of its own, a multilingual VQA task is interesting because it will help create a generic approach/model that works decently well across several languages **With the aim of democratizing such a challenging yet interesting task, in this project, we focus on Mutilingual Visual Question Answering (MVQA)**. Our intention here is to provide a Proof-of-Concept with our simple CLIP-Vision-BERT baseline which leverages a multilingual checkpoint with pre-trained image encoders. Our model currently supports for four languages - **English, French, German and Spanish**.
|
| 13 |
|