LLMCPNER / README.md
xhd521's picture
Add LLMCPNER model card and metadata
702eaaa verified
|
Raw
History Blame Contribute Delete
1.92 kB
metadata
library_name: pytorch
license: mit
base_model: allenai/scibert_scivocab_uncased
tags:
  - named-entity-recognition
  - paleontology
  - scibert
  - curriculum-learning
  - weak-supervision

LLMCPNER

Model checkpoint for the manuscript "LLMCPNER: Integrating Large Language Models and Curriculum Learning for Paleontological Named Entity Recognition", currently under review.

LLMCPNER is a span-based named entity recognition model for paleontological literature. It combines SciBERT, multi-model voting, and confidence-weighted curriculum learning.

Entity types

The model recognizes seven entity types: taxa, location, section, strata, lithology, facies, and age.

Evaluation

The model was evaluated on a manually corrected test set containing 188 texts and 1,348 entities.

Matching criterion Precision Recall F1
Strict 88.19 87.54 87.86
Partial 91.26 90.58 90.92

Strict matching requires exact entity boundaries and type. Partial matching requires at least 50% boundary overlap and the correct entity type.

Files

  • model.pt: PyTorch state dictionary of the final model.
  • label_mapping.json: entity label-to-ID and ID-to-label mappings.
  • training_config.json: core settings recorded for the reported run.

This checkpoint uses a custom span-classification architecture and is not a drop-in AutoModel.from_pretrained() model. The implementation and test set are available in the associated code repository:

https://github.com/goodXHD/LLMCPNER-Integrating-Large-Language-Models-and-Curriculum-Learning-for-Paleontological-Named-Entity

Intended use

The model is intended for research on named entity recognition in English paleontological literature. Performance outside this domain has not been established. Predictions should be reviewed before use in scientific databases or downstream knowledge resources.