|
|
| --- |
| |
| base_model: EvolutionaryScale/esmc-300m-2024-12 |
|
|
| library_name: peft |
|
|
| --- |
| |
|
|
|
|
| # Model Card for Model-Demo-ESMC-300M |
| ## Base model |
|
|
| [EvolutionaryScale/esmc-300m-2024-12] |
|
|
| ## Task description |
|
|
| This is a ESMC_300M model for the Protein-level Regression task and the dataset is the Dataset-RASH_HUMAN. |
|
|
| ## Label meaning |
|
|
| Label means mutation effect score of each protein based on deep mutation scanning experiment, ranging from minus infinity to positive infinity where 0 is value of wildtype, larger means higher fitness. |
|
|
|
|
|
|
| ## Task type |
| Protein-level Regression |
|
|
| ## Model input type |
| AA Sequence |
|
|
| ## LoRA config |
|
|
| - **r:** 8 |
| - **lora_dropout:** 0.0 |
| - **lora_alpha:** 16 |
| - **target_modules:** ['layernorm_qkv.1', 'ffn.1', 'out_proj', 'ffn.3'] |
| - **modules_to_save:** ['classifier'] |
| |
| ## Training config |
| |
| - **optimizer:** |
| - **class:** AdamW |
| - **betas:** (0.9, 0.98) |
| - **weight_decay:** 0.01 |
| - **learning rate:** 0.0001 |
| - **epoch:** 10 |
| - **batch size:** 32 |
| - **precision:** 16-mixed |
|
|
|
|
