| | --- |
| | license: cc-by-4.0 |
| | --- |
| | # xlm_roberta_base_10_5e-05_512_english |
| |
|
| | ## Model Description |
| | This is an **xlm-roberta-base** model finetuned on English training data labelled with the **Illframes Climate Codebook** categories: |
| |
|
| | - **710**: Threatening economic growth |
| | - **720**: Threatening national sovereignty |
| | - **721**: Climate conspiracy |
| | - **722**: Scientific scepticism and denial |
| | - **723**: Climate movement bashing |
| | - **724**: Other polluters as the real problem |
| | - **730**: Threatening energy security |
| | - **740**: Threatening way of life |
| | - **799**: None of them |
| |
|
| | --- |
| |
|
| | ## How to Use the Model |
| |
|
| | ```python |
| | from transformers import AutoTokenizer, pipeline |
| | |
| | tokenizer = AutoTokenizer.from_pretrained("xlm-roberta-base") |
| | pipe = pipeline( |
| | model="poltextlab/illframes-climate_v3", |
| | task="text-classification", |
| | tokenizer=tokenizer, |
| | use_fast=False, |
| | token="<your_hf_read_only_token>" |
| | ) |
| | |
| | text = "The European Green Deal is exactly why people, our citizens, pay increasingly expensive energy and food today..." |
| | pipe(text) |
| | ``` |
| |
|
| | ## Gated Access |
| |
|
| | This model requires gated access. You must pass the token parameter when loading the model. |
| | In earlier versions of the Transformers package, you may need to use the use_auth_token parameter instead. |
| |
|
| | ## Model Performance |
| |
|
| | The model was evaluated on a test set of 374 English examples. |
| |
|
| | **Accuracy**: 0.47 |
| |
|
| | **Precision**: 0.50 |
| |
|
| | **Recall**: 0.47 |
| |
|
| | **Weighted Average F1-score**: 0.48 |
| |
|
| | ## Classification report |
| |
|
| | | Class | Precision | Recall | F1-Score | Support | |
| | | ----- | --------- | ------ | -------- | ------- | |
| | | 710 | 0.41 | 0.46 | 0.43 | 48 | |
| | | 720 | 0.41 | 0.55 | 0.47 | 33 | |
| | | 721 | 0.31 | 0.38 | 0.34 | 48 | |
| | | 722 | 0.40 | 0.53 | 0.46 | 30 | |
| | | 723 | 0.45 | 0.52 | 0.49 | 48 | |
| | | 724 | 0.81 | 0.63 | 0.70 | 40 | |
| | | 730 | 0.65 | 0.54 | 0.59 | 48 | |
| | | 740 | 0.64 | 0.45 | 0.53 | 31 | |
| | | 799 | 0.43 | 0.27 | 0.33 | 48 | |
| |
|
