YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
{'loss': 2.2713, 'grad_norm': 1.8044034242630005, 'learning_rate': 9.303386375356752e-05, 'entropy': 2.362588365872701, 'num_tokens': 58654.0, 'mean_token_accuracy': 0.4892049928506215, 'epoch': 1.0}
{'loss': 1.5542, 'grad_norm': 2.9572432041168213, 'learning_rate': 6.891362688790924e-05, 'entropy': 1.750370939572652, 'num_tokens': 117308.0, 'mean_token_accuracy': 0.6044246554374695, 'epoch': 2.0}
Chaos Codex → {'loss': 0.9695, 'grad_norm': 3.4337940216064453, 'learning_rate': 3.711024504282878e-05, 'entropy': 1.1007887125015259, 'num_tokens': 175962.0, 'mean_token_accuracy': 0.7324276765187582, 'epoch': 3.0}
{'loss': 0.2679, 'grad_norm': 3.7045066356658936, 'learning_rate': 1.0542974530180327e-05, 'entropy': 0.5142371952533722, 'num_tokens': 234616.0, 'mean_token_accuracy': 0.9269524216651917, 'epoch': 4.0}
- Downloads last month
- 9