ai-systems commited on
Commit
c7fe0d5
·
verified ·
1 Parent(s): 151fe6b

Upload 6 files

Browse files
README.md ADDED
@@ -0,0 +1,145 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: sklearn
4
+ pipeline_tag: text-classification
5
+ tags:
6
+ - ai-systems
7
+ - capabilities
8
+ - reasoning
9
+ - planning
10
+ - memory
11
+ - agents
12
+ - world-models
13
+ - verification
14
+ - reliability
15
+ ---
16
+
17
+ # Capability Classifier
18
+
19
+ **Capability Classifier** is a lightweight reference model that maps short AI task descriptions to practical capability categories.
20
+
21
+ It is published under the **ai-systems** handle as a transparent demonstration model for AI-system analysis.
22
+
23
+ ## Capability Labels
24
+
25
+ - `adaptation`
26
+ - `agents`
27
+ - `coding`
28
+ - `memory`
29
+ - `multimodal`
30
+ - `planning`
31
+ - `reasoning`
32
+ - `reliability`
33
+ - `science`
34
+ - `tool-use`
35
+ - `verification`
36
+ - `world-modeling`
37
+
38
+ ## Examples
39
+
40
+ Input:
41
+
42
+ ```text
43
+ Break a complex objective into subtasks and replan after failure.
44
+ ```
45
+
46
+ Expected category:
47
+
48
+ ```text
49
+ planning
50
+ ```
51
+
52
+ Input:
53
+
54
+ ```text
55
+ Predict how the environment will change before acting.
56
+ ```
57
+
58
+ Expected category:
59
+
60
+ ```text
61
+ world-modeling
62
+ ```
63
+
64
+ Input:
65
+
66
+ ```text
67
+ Run tests before accepting generated code.
68
+ ```
69
+
70
+ Expected category:
71
+
72
+ ```text
73
+ verification
74
+ ```
75
+
76
+ ## Usage
77
+
78
+ ```python
79
+ from joblib import load
80
+
81
+ classifier = load("capability-classifier.joblib")
82
+
83
+ text = "Use a browser and API to complete the task"
84
+ prediction = classifier.predict([text])[0]
85
+
86
+ print(prediction)
87
+ ```
88
+
89
+ ## Model Architecture
90
+
91
+ The reference model uses:
92
+
93
+ - TF-IDF text features
94
+ - unigram and bigram features
95
+ - logistic regression classification
96
+
97
+ The model is intentionally small so the classification approach remains easy to inspect and reproduce.
98
+
99
+ ## Training Data
100
+
101
+ The model was trained on a small curated set of short AI-task descriptions covering capability areas such as:
102
+
103
+ - reasoning
104
+ - coding
105
+ - planning
106
+ - memory
107
+ - tool use
108
+ - agents
109
+ - multimodal understanding
110
+ - world modeling
111
+ - verification
112
+ - reliability
113
+ - adaptation
114
+ - science
115
+
116
+ ## Intended Use
117
+
118
+ Suitable for:
119
+
120
+ - capability explorers
121
+ - educational tools
122
+ - lightweight taxonomy experiments
123
+ - AI-system documentation
124
+ - prototyping
125
+ - simple routing demos
126
+
127
+ ## Limitations
128
+
129
+ This is a **reference model**, not a benchmark and not a production-grade classifier.
130
+
131
+ It was trained on a small curated dataset. Predictions outside the covered task descriptions may be unreliable.
132
+
133
+ The model should not be used for medical, legal, financial, safety-critical, or other high-impact decisions.
134
+
135
+ ## Related Dataset
136
+
137
+ `ai-systems/ai-system-patterns`
138
+
139
+ ## Related Model
140
+
141
+ `ai-systems/system-router`
142
+
143
+ ## License
144
+
145
+ Apache-2.0
capability-classifier.joblib ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e119d523364fdf087300eebb8816aace8660bf7ca2a2cb2e24b3fb0179287b20
3
+ size 62108
classifier_config.json ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model_type": "sklearn-text-classifier",
3
+ "name": "capability-classifier",
4
+ "owner": "ai-systems",
5
+ "task": "text-classification",
6
+ "labels": [
7
+ "adaptation",
8
+ "agents",
9
+ "coding",
10
+ "memory",
11
+ "multimodal",
12
+ "planning",
13
+ "reasoning",
14
+ "reliability",
15
+ "science",
16
+ "tool-use",
17
+ "verification",
18
+ "world-modeling"
19
+ ],
20
+ "training_examples": 48,
21
+ "intended_use": "Classify short AI task descriptions into capability categories.",
22
+ "limitations": "Small curated reference model; not intended for production-critical classification."
23
+ }
example_usage.py ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ from joblib import load
2
+
3
+ classifier = load("capability-classifier.joblib")
4
+
5
+ examples = [
6
+ "Break a complex objective into subtasks and replan after failure",
7
+ "Use a browser and API to complete the task",
8
+ "Predict how the environment will change before acting"
9
+ ]
10
+
11
+ for text in examples:
12
+ label = classifier.predict([text])[0]
13
+ confidence = classifier.predict_proba([text])[0].max()
14
+ print(f"{text}\n -> {label} ({confidence:.2f})")
labels.json ADDED
@@ -0,0 +1,14 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [
2
+ "adaptation",
3
+ "agents",
4
+ "coding",
5
+ "memory",
6
+ "multimodal",
7
+ "planning",
8
+ "reasoning",
9
+ "reliability",
10
+ "science",
11
+ "tool-use",
12
+ "verification",
13
+ "world-modeling"
14
+ ]
requirements.txt ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ scikit-learn>=1.4
2
+ joblib>=1.3