| |
|
| | --- |
| | |
| | base_model: esm3-open |
| |
|
| | library_name: esm3 |
| |
|
| | --- |
| | |
| |
|
| |
|
| | # Model Card for Model-Demo-1.4B |
| | <slot name='description'> |
| |
|
| | ## Task type |
| | Protein-level Classification |
| |
|
| | ## Model input type |
| | AA Sequence |
| |
|
| | ## ESM3 Model config |
| |
|
| | - **base_model:** esm3-open |
| | - **model_type:** ESM3 Fine-tuning |
| | - **task_type:** Protein-level Classification |
| | |
| | ## Training config |
| | |
| | - **optimizer:** |
| | - **class:** AdamW |
| | - **betas:** (0.9, 0.98) |
| | - **weight_decay:** 0.01 |
| | - **learning rate:** 0.0005 |
| | - **epoch:** 5 |
| | - **batch size:** 1 |
| | - **precision:** 16-mixed |
| |
|
| |
|