Instructions to use google/fnet-large with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use google/fnet-large with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForPreTraining tokenizer = AutoTokenizer.from_pretrained("google/fnet-large") model = AutoModelForPreTraining.from_pretrained("google/fnet-large") - Notebooks
- Google Colab
- Kaggle
Commit ·
d8d6aed
1
Parent(s): 156c3c9
Update README.md
Browse files
README.md
CHANGED
|
@@ -11,7 +11,7 @@ datasets:
|
|
| 11 |
|
| 12 |
Pretrained model on English language using a masked language modeling (MLM) and next sentence prediction (NSP) objective. It was
|
| 13 |
introduced in [this paper](https://arxiv.org/abs/2105.03824) and first released in [this repository](https://github.com/google-research/google-research/tree/master/f_net).
|
| 14 |
-
This model is
|
| 15 |
|
| 16 |
Disclaimer: This model card has been written by [gchhablani](https://huggingface.co/gchhablani).
|
| 17 |
|
|
|
|
| 11 |
|
| 12 |
Pretrained model on English language using a masked language modeling (MLM) and next sentence prediction (NSP) objective. It was
|
| 13 |
introduced in [this paper](https://arxiv.org/abs/2105.03824) and first released in [this repository](https://github.com/google-research/google-research/tree/master/f_net).
|
| 14 |
+
This model is cased: it makes a difference between english and English. The model achieves 0.58 accuracy on MLM objective and 0.80 on NSP objective.
|
| 15 |
|
| 16 |
Disclaimer: This model card has been written by [gchhablani](https://huggingface.co/gchhablani).
|
| 17 |
|