Spaces:
Sleeping
Sleeping
Commit
Β·
df20a13
1
Parent(s):
ebff9dd
Change batch size to 100 webhook events
Browse filesReduce batch size from 10,000 to 100 messages for more frequent saves and faster feedback during testing.
Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
README.md
CHANGED
|
@@ -18,7 +18,7 @@ A Gradio Space that receives and processes HuggingFace Hub webhooks, storing the
|
|
| 18 |
- β
Receives HuggingFace Hub webhooks via `/webhooks/hub` endpoint
|
| 19 |
- β
Filters webhooks by scope (`repo` and `repo.content` only)
|
| 20 |
- β
Stores webhook payloads in memory
|
| 21 |
-
- β
Automatically batches and saves to dataset every
|
| 22 |
- β
Saves as efficient parquet files for easy querying
|
| 23 |
- β
Real-time status dashboard
|
| 24 |
|
|
|
|
| 18 |
- β
Receives HuggingFace Hub webhooks via `/webhooks/hub` endpoint
|
| 19 |
- β
Filters webhooks by scope (`repo` and `repo.content` only)
|
| 20 |
- β
Stores webhook payloads in memory
|
| 21 |
+
- β
Automatically batches and saves to dataset every 100 messages
|
| 22 |
- β
Saves as efficient parquet files for easy querying
|
| 23 |
- β
Real-time status dashboard
|
| 24 |
|
app.py
CHANGED
|
@@ -14,7 +14,7 @@ app = FastAPI()
|
|
| 14 |
|
| 15 |
# Configuration
|
| 16 |
DATASET_REPO = "assafvayner/webhook-messages"
|
| 17 |
-
BATCH_SIZE =
|
| 18 |
ALLOWED_SCOPES = {"repo", "repo.content"}
|
| 19 |
|
| 20 |
# In-memory storage
|
|
@@ -113,7 +113,7 @@ with gr.Blocks(title="HuggingFace Webhook Processor") as demo:
|
|
| 113 |
|
| 114 |
## Configuration
|
| 115 |
- **Filtered Scopes**: `repo`, `repo.content`
|
| 116 |
-
- **Batch Size**:
|
| 117 |
- **Dataset**: `assafvayner/webhook-messages`
|
| 118 |
|
| 119 |
## Status
|
|
|
|
| 14 |
|
| 15 |
# Configuration
|
| 16 |
DATASET_REPO = "assafvayner/webhook-messages"
|
| 17 |
+
BATCH_SIZE = 100
|
| 18 |
ALLOWED_SCOPES = {"repo", "repo.content"}
|
| 19 |
|
| 20 |
# In-memory storage
|
|
|
|
| 113 |
|
| 114 |
## Configuration
|
| 115 |
- **Filtered Scopes**: `repo`, `repo.content`
|
| 116 |
+
- **Batch Size**: 100 messages
|
| 117 |
- **Dataset**: `assafvayner/webhook-messages`
|
| 118 |
|
| 119 |
## Status
|