update readme
Browse files
    	
        README.md
    CHANGED
    
    | @@ -3,7 +3,11 @@ | |
| 3 | 
             
            **Work in progress**
         | 
| 4 |  | 
| 5 | 
             
            ## Introduction 
         | 
| 6 | 
            -
            SciBERT-based model pre-trained with materials science scientific  | 
|  | |
|  | |
|  | |
|  | |
| 7 |  | 
| 8 | 
             
            ## TLDR
         | 
| 9 | 
             
            - Collected full-text from ~700000 articles provided by the National Institute for Materials Science (NIMS) TDM platform (https://dice.nims.go.jp/services/TDM-PF/en/), dataset called ScienceCorpus (SciCorpus)
         | 
| @@ -16,13 +20,11 @@ SciBERT-based model pre-trained with materials science scientific fulltexts | |
| 16 |  | 
| 17 | 
             
            ## Related work
         | 
| 18 |  | 
| 19 | 
            -
            ### BERT Implementations | 
| 20 | 
            -
            - 
         | 
| 21 | 
             
            - BERT (the original) https://arxiv.org/abs/1810.04805
         | 
| 22 | 
             
            - RoBERTa (Re-implementation by Facebook) https://arxiv.org/abs/1907.11692
         | 
| 23 |  | 
| 24 | 
             
            ### Relevant models
         | 
| 25 | 
            -
             | 
| 26 | 
             
            - SciBERT: BERT, from scratch, scientific articles (biology + CS) https://github.com/allenai/scibert
         | 
| 27 | 
             
            - MatSciBERT (Gupta): RoBERTa, from scratch, SciBERT vocab and weights, ~150 K paper limited to 4 MS families http://github.com/m3rg-iitd/matscibert
         | 
| 28 | 
             
            - MaterialBERT: Not yet published
         | 
|  | |
| 3 | 
             
            **Work in progress**
         | 
| 4 |  | 
| 5 | 
             
            ## Introduction 
         | 
| 6 | 
            +
            SciBERT-based model pre-trained with materials science scientific fulltext
         | 
| 7 | 
            +
             | 
| 8 | 
            +
            ## Authors
         | 
| 9 | 
            +
            Luca Foppiano
         | 
| 10 | 
            +
            Pedro Ortiz Suarez
         | 
| 11 |  | 
| 12 | 
             
            ## TLDR
         | 
| 13 | 
             
            - Collected full-text from ~700000 articles provided by the National Institute for Materials Science (NIMS) TDM platform (https://dice.nims.go.jp/services/TDM-PF/en/), dataset called ScienceCorpus (SciCorpus)
         | 
|  | |
| 20 |  | 
| 21 | 
             
            ## Related work
         | 
| 22 |  | 
| 23 | 
            +
            ### BERT Implementations
         | 
|  | |
| 24 | 
             
            - BERT (the original) https://arxiv.org/abs/1810.04805
         | 
| 25 | 
             
            - RoBERTa (Re-implementation by Facebook) https://arxiv.org/abs/1907.11692
         | 
| 26 |  | 
| 27 | 
             
            ### Relevant models
         | 
|  | |
| 28 | 
             
            - SciBERT: BERT, from scratch, scientific articles (biology + CS) https://github.com/allenai/scibert
         | 
| 29 | 
             
            - MatSciBERT (Gupta): RoBERTa, from scratch, SciBERT vocab and weights, ~150 K paper limited to 4 MS families http://github.com/m3rg-iitd/matscibert
         | 
| 30 | 
             
            - MaterialBERT: Not yet published
         | 
