--- license: apache-2.0 language: - en library_name: transformers pipeline_tag: text-classification base_model: distilbert/distilbert-base-uncased datasets: - OniReimu/Edge-Computing-JEV tags: - edge-computing - service-orchestration - intent-classification --- # Edge-Computing-JEV service classifiers Four DistilBERT service classifiers used as reference interpreters in RQ4 (dynamic service catalog) of the paper > **Replacing Large Language Models with Jev Decision Models for Low-Latency Edge Service Orchestration** > Delong Li, Xu Wang, Haochen Gong, Rui Lang, and Guangsheng Yu. University of Technology Sydney. Each classifier maps a natural-language edge-service request to one service of a fixed catalog (or `unsupported`). They show what a trained classifier needs when the catalog changes, in contrast to decision models and LLMs that receive the catalog with each request. Code: [github.com/OniReimu/Edge-Computing-JEV](https://github.com/OniReimu/Edge-Computing-JEV) ยท Benchmark and run records: [datasets/OniReimu/Edge-Computing-JEV](https://huggingface.co/datasets/OniReimu/Edge-Computing-JEV) ## Models Every classifier is trained from `distilbert/distilbert-base-uncased` at revision `12040accade4e8a0f71eabdb258fecc2e7e948be`. | Folder | Paper name | Labels | Training examples | Used for | |---|---|---|---|---| | `clf_all` | DistilBERT-Clf-All | 255 (254 services + `unsupported`) | 554: one description per service + 300 development cases of the catalog-size conditions | RQ4 catalog-size conditions (K = 4 to 254) | | `clf_frozen` | DistilBERT-Clf-Frozen | 65 (64 services of catalog v0 + `unsupported`) | 322: one description per service + 258 development cases | RQ4 churn conditions, without adaptation | | `clf_retrained_25` | DistilBERT-Clf-Retrained (25% churn) | 65 (catalog v1) | 339, of which 76 are new labelled examples (16 descriptions of new services + 60 churn development cases) | RQ4 25% churn | | `clf_retrained_50` | DistilBERT-Clf-Retrained (50% churn) | 65 (catalog v2) | 278, of which 92 are new labelled examples (32 descriptions of new services + 60 churn development cases) | RQ4 50% churn | Training examples come only from the EdgeIntent v1 development split and the catalog descriptions; no test case is used. Hyperparameters are fixed, with no search: max length 128, learning rate 5e-5, batch size 16, 10 epochs, weight decay 0.01, seed 20260924, trained on Apple M4 Max (MPS). Each folder's `training.json` records the label space, example counts, and training wall time. `scripts/eb_rq4_train.py` in the GitHub repository rebuilds all four. ## Results on the churn conditions Service top-1 accuracy on the EdgeIntent v1 test split, from `experiments/rq1-rq4-interpretation/results/h5_classifier_reference.csv`: | Condition | Classifier | Seen services | Unseen services | |---|---|---|---| | 25% churn | Frozen | 0.653 | 0.000 | | 25% churn | Retrained | 0.708 | 0.147 | | 50% churn | Frozen | 0.522 | 0.000 | | 50% churn | Retrained | 0.441 | 0.142 | Results on the catalog-size conditions are in `experiments/rq1-rq4-interpretation/results/cells.csv` (model `DistilBERT-Clf-All`). ## Usage ```python from transformers import AutoTokenizer, AutoModelForSequenceClassification repo = "OniReimu/Edge-Computing-JEV-classifiers" tok = AutoTokenizer.from_pretrained(repo, subfolder="clf_all") model = AutoModelForSequenceClassification.from_pretrained(repo, subfolder="clf_all") inputs = tok("Please read the licence plate on the gate camera frame, keep it on site.", return_tensors="pt", truncation=True, max_length=128) print(model.config.id2label[model(**inputs).logits.argmax(-1).item()]) ``` ## Limitations These are reference baselines trained with a small, fixed recipe on synthetic requests. They are not tuned and are not intended for deployment. ## License Apache-2.0, as the base model.