History

Hibryda 6459877c89 fix: change dev port from 9700 to 9710 (avoid BridgeCoach conflict) Port 9700 was occupied by BridgeCoach Docker container, causing the Tauri debug binary to load the wrong frontend. Changed to 9710: - vite.config.ts: server.port 9700 → 9710 - tauri.conf.json: devUrl localhost:9700 → localhost:9710 - wdio.conf.js: DEV_URL_PORT check updated - Binary rebuilt with new port baked in		2026-03-18 04:20:49 +01:00
..
infra	refactor(e2e): extract infrastructure into tests/e2e/infra/ module	2026-03-18 03:06:57 +01:00
specs	test(e2e): split + expand phase-b into grid + LLM specs	2026-03-18 03:47:16 +01:00
README.md	fix(e2e): use dedicated port 9750 for tauri-driver (avoid conflicts)	2026-03-18 03:58:21 +01:00
tsconfig.json	feat: Agent Orchestrator — multi-project agent dashboard	2026-03-15 15:45:27 +01:00
wdio.conf.js	fix: change dev port from 9700 to 9710 (avoid BridgeCoach conflict)	2026-03-18 04:20:49 +01:00

README.md

E2E Testing Module

Browser automation tests for Agent Orchestrator using WebDriverIO + tauri-driver.

Quick Start

# Preflight check (validates dependencies)
./scripts/preflight-check.sh

# Build debug binary + run E2E
npm run test:all:e2e

# Run E2E only (skip build)
SKIP_BUILD=1 npm run test:e2e

# Headless (CI)
xvfb-run --auto-servernum npm run test:e2e

System Dependencies

Tool	Required	Install
tauri-driver	Yes	`cargo install tauri-driver` (runs on port 9750)
Debug binary	Yes	`cargo tauri build --debug --no-bundle`
X11/Wayland	Yes (Linux)	Use `xvfb-run` in CI
Claude CLI	Optional	LLM-judged tests skip if absent
ANTHROPIC_API_KEY	Optional	Alternative to Claude CLI for LLM judge

Directory Structure

tests/e2e/
├── wdio.conf.js          # WebDriverIO config + tauri-driver lifecycle
├── tsconfig.json          # TypeScript config for specs
├── README.md              # This file
├── infra/                 # Test infrastructure (not specs)
│   ├── fixtures.ts        # Test fixture generator (isolated temp dirs)
│   ├── llm-judge.ts       # LLM-based assertion engine (Claude CLI / API)
│   ├── results-db.ts      # JSON test results store
│   └── test-mode-constants.ts  # Typed env var names for test mode
└── specs/                 # Test specifications
    ├── agor.test.ts       # Smoke + UI tests (50+ tests)
    ├── phase-a-structure.test.ts  # Phase A: structural integrity + settings (12 tests)
    ├── phase-a-agent.test.ts      # Phase A: agent pane + prompts (15 tests)
    ├── phase-a-navigation.test.ts # Phase A: terminal + palette + focus (15 tests)
    ├── phase-b.test.ts    # Phase B: multi-project + LLM judge
    └── phase-c.test.ts    # Phase C: hardening features (11 scenarios)

Test Mode Environment Variables

Variable	Purpose	Read By
`AGOR_TEST=1`	Enable test isolation	config.rs, misc.rs, lib.rs, watcher.rs, fs_watcher.rs, telemetry.rs, App.svelte
`AGOR_TEST_DATA_DIR`	Override data dir	config.rs
`AGOR_TEST_CONFIG_DIR`	Override config dir	config.rs

Effects when AGOR_TEST=1:

File watchers disabled (watcher.rs, fs_watcher.rs)
OTLP telemetry export disabled (telemetry.rs)
CLI tool installation skipped (lib.rs)
Wake scheduler disabled (App.svelte)
Test env vars forwarded to sidecar processes (lib.rs)

Test Phases

Phase	File	Tests	Type
Smoke	agor.test.ts	50+	Deterministic (CSS/DOM assertions)
A	phase-a-{structure,agent,navigation}.test.ts	42	Deterministic (data-testid selectors)
B	phase-b.test.ts	6+	LLM-judged (multi-project, agent quality)
C	phase-c.test.ts	11 scenarios	Mixed (deterministic + LLM-judged)

Adding a New Spec

Create tests/e2e/specs/my-feature.test.ts
Import from @wdio/globals for browser and expect
Use data-testid selectors (preferred) or CSS classes
Add to wdio.conf.js specs array
For LLM assertions: import { assertWithJudge } from '../infra/llm-judge'
Run ./scripts/check-test-flags.sh if you added new AGOR_TEST references

CI Workflow

See .github/workflows/e2e.yml — 3 jobs:

unit-tests: vitest frontend
cargo-tests: Rust backend
e2e-tests: WebDriverIO (xvfb-run, Phase A+B+C, LLM tests gated on secret)