servicetitan/arcade-eval
2
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

cat1: dynamic registration PASS (saved edit -Brightdata +Youtube reflected live, no restart)

Browse Source
This commit is contained in:
iztaylor
2026-06-18 11:06:20 -04:00
parent 2d02ddbd35
commit a0d9bcf2fc
4 changed files with 19 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files
categories/cat1-functional/tests/probes.md
+12
View File
@@ -44,3 +44,15 @@ The Engine processed the call and failed cleanly because the Slack OAuth provide
(the gateway's "Missing Requirements"). Demonstrates: invocation routes through the Engine, returns a
structured error result, and does **not** fall back to a shared credential. Clean per-call invocation
without per-user OAuth + a project secret (e.g. serp_api_key) is deferred to the reference server (`echo`).
## Dynamic registration (2.5) — criteria 7 & 8, benchmark Q3
Edited `zeb-gateway-test` in the dashboard: removed `Brightdata_ScrapeAsMarkdown`, added
`Youtube_SearchForVideos`. A fresh `tools/list`:
```
added since first probe: ['Youtube_SearchForVideos']
removed since first probe: ['Brightdata_ScrapeAsMarkdown']
```
**PASS** — change took effect on the next list with **no engine/server restart** (gateway = pure
metadata). Corollary: the edit did **not** propagate while unsaved (draft); it appeared only after
**Save** — correct/expected, not a defect. Propagation was effectively immediate (next poll).