assafvayner HF Staff Claude Sonnet 4.5 commited on
Commit
df20a13
Β·
1 Parent(s): ebff9dd

Change batch size to 100 webhook events

Browse files

Reduce batch size from 10,000 to 100 messages for more frequent saves and faster feedback during testing.

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>

Files changed (2) hide show
  1. README.md +1 -1
  2. app.py +2 -2
README.md CHANGED
@@ -18,7 +18,7 @@ A Gradio Space that receives and processes HuggingFace Hub webhooks, storing the
18
  - βœ… Receives HuggingFace Hub webhooks via `/webhooks/hub` endpoint
19
  - βœ… Filters webhooks by scope (`repo` and `repo.content` only)
20
  - βœ… Stores webhook payloads in memory
21
- - βœ… Automatically batches and saves to dataset every 10,000 messages
22
  - βœ… Saves as efficient parquet files for easy querying
23
  - βœ… Real-time status dashboard
24
 
 
18
  - βœ… Receives HuggingFace Hub webhooks via `/webhooks/hub` endpoint
19
  - βœ… Filters webhooks by scope (`repo` and `repo.content` only)
20
  - βœ… Stores webhook payloads in memory
21
+ - βœ… Automatically batches and saves to dataset every 100 messages
22
  - βœ… Saves as efficient parquet files for easy querying
23
  - βœ… Real-time status dashboard
24
 
app.py CHANGED
@@ -14,7 +14,7 @@ app = FastAPI()
14
 
15
  # Configuration
16
  DATASET_REPO = "assafvayner/webhook-messages"
17
- BATCH_SIZE = 10000
18
  ALLOWED_SCOPES = {"repo", "repo.content"}
19
 
20
  # In-memory storage
@@ -113,7 +113,7 @@ with gr.Blocks(title="HuggingFace Webhook Processor") as demo:
113
 
114
  ## Configuration
115
  - **Filtered Scopes**: `repo`, `repo.content`
116
- - **Batch Size**: 10,000 messages
117
  - **Dataset**: `assafvayner/webhook-messages`
118
 
119
  ## Status
 
14
 
15
  # Configuration
16
  DATASET_REPO = "assafvayner/webhook-messages"
17
+ BATCH_SIZE = 100
18
  ALLOWED_SCOPES = {"repo", "repo.content"}
19
 
20
  # In-memory storage
 
113
 
114
  ## Configuration
115
  - **Filtered Scopes**: `repo`, `repo.content`
116
+ - **Batch Size**: 100 messages
117
  - **Dataset**: `assafvayner/webhook-messages`
118
 
119
  ## Status