Test MCP Config

1. POST /api/v1/sandboxes              -> start a sandbox (no conversation)
2. GET  /api/v1/sandboxes?id=<id>      -> poll until status == RUNNING
3. read exposed_urls[AGENT_SERVER]     -> the sandbox's agent-server URL
   and session_api_key                    + per-sandbox session key
4. POST {agent_server}/api/mcp/test    -> validate each server config

{"ok": true,  "tools": ["..."], "tool_result": null}
{"ok": false, "error": "Client failed to connect: ...", "error_kind": "connection"}

export OH_API_KEY=...    # OpenHands Cloud API key

pip install requests
# or, from the repo root: uv run --with requests test-mcp-config/test_mcp_config.py ...

# Single remote (streamable-http) server with a bearer token
python test_mcp_config.py \
    --url https://mcp.example.com/mcp --type shttp --server-api-key "$TOKEN"

# Use an explicit header instead of --server-api-key, and verify credentials
# by invoking a known read-only tool (listing tools alone often won't):
python test_mcp_config.py --url https://mcp.example.com/mcp \
    --header "Authorization=Bearer $TOKEN" \
    --tool-call list_things

# Stdio (subprocess) server.
# NOTE: values starting with "-" (e.g. npx's "-y") must use the --flag=value
# form, otherwise argparse treats them as options. This applies to
# --arg / --env / --header / --tool-arg.
python test_mcp_config.py --command npx --arg=-y --arg some-mcp-server

# Test every server in an SDK-style config file
python test_mcp_config.py --config my_mcp_config.json

# Test the servers actually saved in your account settings
python test_mcp_config.py --from-settings

# Reuse a sandbox you already started (skips create + delete)
python test_mcp_config.py --sandbox-id <id> --url https://mcp.example.com/mcp

# List configured servers without starting a sandbox (no secrets printed)
python test_mcp_config.py --from-settings --list

# Test only specific servers by name (repeatable)
python test_mcp_config.py --from-settings --server jira --server figma

{
  "mcpServers": {
    "jira":  {"url": "https://mcp-jira.example.com/http",  "transport": "http"},
    "figma": {"url": "https://mcp-figma.example.com/mcp", "transport": "http"},
    "local": {"command": "npx", "args": ["-y", "some-mcp-server"]}
  }
}

sandbox: 2092i4jTpja41kRuzNcLIJ
  status: RUNNING
agent: https://<runtime-host>.prod-runtime.all-hands.dev

--- everything_reference  (stdio: npx) ---
  OK  connected; 13 tool(s): echo, get-annotated-message, get-env, ...

--- bad_dns  (http: http://nonexistent.invalid/mcp) ---
  FAIL  [connection] Client failed to connect: [Errno -2] Name or service not known

--- conn_refused  (http: http://127.0.0.1:1/mcp) ---
  FAIL  [connection] Client failed to connect: All connection attempts failed

1/3 server(s) OK.

Deleting sandbox 2092i4jTpja41kRuzNcLIJ ...