xhd521 commited on
Commit
702eaaa
·
verified ·
1 Parent(s): 6c56738

Add LLMCPNER model card and metadata

Browse files
Files changed (3) hide show
  1. README.md +59 -0
  2. label_mapping.json +23 -0
  3. training_config.json +18 -0
README.md ADDED
@@ -0,0 +1,59 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: pytorch
3
+ license: mit
4
+ base_model: allenai/scibert_scivocab_uncased
5
+ tags:
6
+ - named-entity-recognition
7
+ - paleontology
8
+ - scibert
9
+ - curriculum-learning
10
+ - weak-supervision
11
+ ---
12
+
13
+ # LLMCPNER
14
+
15
+ Model checkpoint for the manuscript **"LLMCPNER: Integrating Large Language
16
+ Models and Curriculum Learning for Paleontological Named Entity Recognition"**,
17
+ currently under review.
18
+
19
+ LLMCPNER is a span-based named entity recognition model for paleontological
20
+ literature. It combines SciBERT, multi-model voting, and confidence-weighted
21
+ curriculum learning.
22
+
23
+ ## Entity types
24
+
25
+ The model recognizes seven entity types: `taxa`, `location`, `section`,
26
+ `strata`, `lithology`, `facies`, and `age`.
27
+
28
+ ## Evaluation
29
+
30
+ The model was evaluated on a manually corrected test set containing 188 texts
31
+ and 1,348 entities.
32
+
33
+ | Matching criterion | Precision | Recall | F1 |
34
+ | --- | ---: | ---: | ---: |
35
+ | Strict | 88.19 | 87.54 | 87.86 |
36
+ | Partial | 91.26 | 90.58 | 90.92 |
37
+
38
+ Strict matching requires exact entity boundaries and type. Partial matching
39
+ requires at least 50% boundary overlap and the correct entity type.
40
+
41
+ ## Files
42
+
43
+ - `model.pt`: PyTorch state dictionary of the final model.
44
+ - `label_mapping.json`: entity label-to-ID and ID-to-label mappings.
45
+ - `training_config.json`: core settings recorded for the reported run.
46
+
47
+ This checkpoint uses a custom span-classification architecture and is not a
48
+ drop-in `AutoModel.from_pretrained()` model. The implementation and test set
49
+ are available in the associated code repository:
50
+
51
+ https://github.com/goodXHD/LLMCPNER-Integrating-Large-Language-Models-and-Curriculum-Learning-for-Paleontological-Named-Entity
52
+
53
+ ## Intended use
54
+
55
+ The model is intended for research on named entity recognition in English
56
+ paleontological literature. Performance outside this domain has not been
57
+ established. Predictions should be reviewed before use in scientific databases
58
+ or downstream knowledge resources.
59
+
label_mapping.json ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "label2id": {
3
+ "O": 0,
4
+ "taxa": 1,
5
+ "location": 2,
6
+ "section": 3,
7
+ "strata": 4,
8
+ "lithology": 5,
9
+ "facies": 6,
10
+ "age": 7
11
+ },
12
+ "id2label": {
13
+ "0": "O",
14
+ "1": "taxa",
15
+ "2": "location",
16
+ "3": "section",
17
+ "4": "strata",
18
+ "5": "lithology",
19
+ "6": "facies",
20
+ "7": "age"
21
+ }
22
+ }
23
+
training_config.json ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "method": "positive_confidence_curriculum",
3
+ "base_model": "allenai/scibert_scivocab_uncased",
4
+ "seed": 13,
5
+ "batch_size": 8,
6
+ "learning_rate": 2e-5,
7
+ "prediction_threshold": 0.3,
8
+ "num_voters": 3,
9
+ "voter_sample_ratio": 0.6,
10
+ "voter_epochs": 1,
11
+ "minimum_positive_weight": 0.7,
12
+ "curriculum_percentiles": [30, 0, 0],
13
+ "stage_epochs": [1, 0, 0],
14
+ "training_samples": 25460,
15
+ "training_entities": 159024,
16
+ "test_samples": 188,
17
+ "test_entities": 1348
18
+ }