admin/Claw3D

Fork 0

mirror of https://github.com/iamlukethedev/Claw3D.git synced 2026-08-14 00:58:04 +00:00

Files

T

4e552967d9 [PRIORITY][FEAT] merge runtime profiles, office systems, doctor, and vera lane convergence (#109 )

* fix: include kanbanImmersive in immersiveOverlayActive calculation

When Kanban board is open, HUD elements (camera preset buttons, edit toolbar, overlays) should be suppressed. The kanbanImmersive flag was defined but not included in the immersiveOverlayActive condition, causing HUD elements to remain visible.

This fix adds kanbanImmersive to the immersiveOverlayActive calculation so HUD elements are properly hidden when the Kanban board is open.

Co-authored-by: Luke The Dev <iamlukethedev@users.noreply.github.com>

* Fix: Hide mini status bar when Kanban immersive overlay is open

Wraps the bottom-left mini status bar (showing agent stats, vibe score, and
control hints) with !immersiveOverlayActive check to match the behavior of
other HUD elements like camera controls and toolbar.

This ensures the status bar is properly hidden when the Kanban board or any
other immersive overlay is active, maintaining a clean immersive experience.

Co-authored-by: Luke The Dev <iamlukethedev@users.noreply.github.com>

* chore: drop unrelated package-lock line from branch

Co-authored-by: Luke The Dev <iamlukethedev@users.noreply.github.com>

* universal-backend-plan

* backend-neutral runtime seam

* package.json update

* feat: add Hermes gateway adapter as alternative to OpenClaw

Adds a WebSocket adapter that lets Claw3D connect to a Hermes AI agent
runtime without any changes to the frontend. The adapter implements the
full Claw3D gateway protocol and bridges it to the Hermes HTTP API.

Changes:
- server/hermes-gateway-adapter.js: WebSocket bridge implementing the
  Claw3D gateway protocol against the Hermes HTTP API. Supports all
  core methods (agents, sessions, chat streaming, cron, config, files,
  approvals) and multi-agent orchestration via spawn_agent/delegate_task
  tools. Persists conversation history to ~/.hermes/clawd3d-history.json.
- scripts/clawd3d-start.sh: All-in-one startup script that launches
  Hermes, the adapter, and the Next.js dev server with auto port
  conflict resolution. Alias as `claw3d` for convenience.
- src/features/office/hooks/useCronAgents.ts: Hook that polls the
  gateway for cron-scheduled agents and surfaces them in the 3D office.
- package.json: adds `hermes-adapter` npm script
- .env.example: documents Hermes config vars
- docs/hermes-gateway.md: setup guide and protocol reference

Usage:
  npm run hermes-adapter   # start adapter (connect to http://localhost:8642)
  npm run dev              # start Claw3D, point browser at localhost:3000
  # or: bash scripts/clawd3d-start.sh  (starts everything automatically)

Both OpenClaw and Hermes are supported simultaneously — the gateway URL
in NEXT_PUBLIC_GATEWAY_URL determines which backend Claw3D connects to.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* feat: add read_agent_context tool for cross-agent coordination

Agents can now read each other's conversation history via the
read_agent_context tool, enabling the orchestrator to check what
a sub-agent has done before re-delegating work.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* feat: wire Hermes office UX and role-aware runtime updates

* feature update - demomode & hermes adapter

* fix lint blockers

* lintfix #2

* fix: stabilize retro office camera preset callbacks

* Initial plan

* fix: stabilize retro office overview preset hooks

Agent-Logs-Url: https://github.com/gsknnft/Claw3D/sessions/9cc71555-591e-44cf-aec4-25affbdcb405

Co-authored-by: gsknnft <123185582+gsknnft@users.noreply.github.com>

* feat: add truthful backend selection, Hermes adapter hardening, and demo gateway mode

* fix: address bugbot review and finalize backend selection

* fixed - onboarding and hermes calls

* office systems roadmap

* feat specs in docs

* specs ready

* feat: continue custom runtime seam and gateway alignment

* custom lane wired

* feat: add custom runtime provider path and office runtime alignment

* office_sys prep

* tighten multi-floor runtime spec

* multi-floor v1 implementation

* moved floor nav

* runtime architecture specs

* claw3doctor specs

* feat: add first pass claw3doctor diagnostics

* docs: align roadmap with runtime profiles and office systems priorities

* feat: expand claw3doctor provider diagnostics and json output

* feat: improve claw3doctor formatting and multi-runtime diagnostics

* feat: formalize runtime profile resolution

* feat: expand claw3doctor profile health diagnostics

* feat: polish claw3doctor output and tunnel remediation

* feat: add claw3doctor profile scoping and failure classification

* docs: define claw3doctor v1 boundary and v2 backlog

* test: fix stale claw3doctor branch expectations

* test: fix stale expectations on claw3doctor branch

* fix(claw3doctor): scope provider-specific checks to --profile / --all-profiles flags

PR #101 finding:
- Medium: --profile <adapter> and --all-profiles only scoped the profile health
  probe loop; OpenClaw/Hermes/Demo/Custom check blocks still ran based on the
  selected adapter type in runtimeContext, making CLI output misleading.

Fix: introduce adapterInScope(adapterType, defaultBehavior) helper in main().
  - --profile <adapter>  -> only that adapter's checks run
  - --all-profiles       -> all adapter checks run
  - no flag              -> falls back to existing shouldRun* predicate (unchanged)

Also:
- Export parseDoctorArgs from claw3doctor-core.mjs (removed duplicate in script)
- Add test suites: parseDoctorArgs flag parsing (6 cases) and
  adapterInScope scoping semantics (4 cases) — 10 new tests, all green

* fix(office): persist per-floor selectedAgentId on focusLocalAgent + wire officeFloors runtime state

PR #96 findings:
- Medium #1: focusLocalAgent now writes selectedAgentId back to floorRosterCache
  so handleSelectFloor restores the agent the user last picked on each floor
  rather than snapping back to the hydration-time suggestion.
- Medium #2: Add useEffect that calls settingsCoordinator.schedulePatch with
  officeFloors[activeFloorId] patch on every status/gatewayUrl change, writing
  status, gatewayUrl, lastKnownGoodAt, lastErrorCode, and lastErrorMessage so
  the persisted floor runtime state actually tracks live connection transitions.

* fix unkept changes

* fix audit findings - cross-floor misattribution & officefloors silent drops

* pushed changes

* multi-agentic runtime & chat bubble fix

* partial parity with office-sys-next

* claw3doctor parity

* partial parity with v_lane

* merged feat/office-systems-next -> merge_sys

* parity across PR branches

* rm *.orig postmerge

* full parity across unmerged PRs & main

* fix lukes findings

* fix findings - bigger chatbox

* real local upload path

* fixed file upload, MIME integgration

* minor fix

* fix lukess findings

* deleted *.orig

* three bugs fixed - gatewayclient, coord, claw3doctor

* address findings

* fix lukes findings

* fix findings #2

* fix: ignore temporary skill-agent names during identity recovery

* fix: preserve stable identity names during temp-name recovery

* fix(gateway): correct disconnect race and token-blanking on adapter switch

- disconnect() now checks actual connection status rather than selectedAdapterType,
  which may already reflect the target adapter when the effect fires. Prevents stale
  WebSocket clients from persisting after switching to local/claw3d/custom backends.
- setSelectedAdapterType() falls back to loadedGatewaySettings.current.profiles token
  when the in-memory adapterProfiles entry has an empty token (sanitized API form).
  Prevents saved tokens from being cleared when switching between backends.

Closes Luke findings: High (stale gateway on floor switch), Medium (token blanking).

Authored-By: GSKNNFT

* feat(gateway): loopback bypass, control-ui remap, operator.read scope, 75ms connect

Cherry-picked clean additions from pr/gsknnft-2 (fix/reduce-gateway-connect-delay):

- proxy-url.ts: resolveStudioProxyGatewayUrl() now accepts optional upstreamGatewayUrl;
  loopback hosts (localhost/127.0.0.1/::1) bypass the Studio proxy and connect directly
- gateway-proxy.js: remap unauthenticated openclaw-control-ui connections to webchat-ui
  client ID so OpenClaw doesn't reject them as unknown clients
- GatewayBrowserClient.ts + nodeGatewayClient.ts: add operator.read scope to both
  browser and Node gateway clients for expanded access control
- GatewayBrowserClient.ts: reduce socket open→connect delay from 750ms to 75ms

GatewayClient.ts rewrites from that PR were intentionally excluded — they would
regress our disconnect-race fix, token-blanking fix, broken-regex fix, local/claw3d
adapter support, adapterProfiles type export, and private envelope path.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

* fix(floor-nav): show only available floors per active adapter; block hang on unconfigured runtime

- floors.ts: add paperclip to FloorProvider; add listAvailableFloorsForAdapter() —
  lobby always visible, runtime floors only shown when their provider matches the
  active adapter, so demo-only users only see Lobby
- OfficeFloorNav: accept activeAdapterType prop, filter floor list via
  listAvailableFloorsForAdapter(); fall back displayActiveFloorId to lobby if current
  floor is no longer in the available set
- OfficeScreen: pass selectedAdapterType to OfficeFloorNav; add guard in
  handleSelectFloor — bail back to lobby immediately when a runtime floor has no
  gateway URL configured, preventing the connect-hang limbo state

Authored-By: GSKNNFT

* hardening: drop unsafe-eval in production CSP; add TRUSTED_PROXY IP resolution

next.config.ts:
- unsafe-eval removed from production script-src (Next.js dev/HMR needs it, but
  production build does not; React and Three.js make no use of eval)
- connect-src intentionally kept broad with note: gateway URLs are user-configured
  at runtime, cannot be enumerated at build time

server/access-gate.js:
- Add resolveClientIp() helper: when TRUSTED_PROXY=1 env var is set, prefer the
  first value of X-Forwarded-For for rate-limiter keying (correct behavior behind
  nginx/Caddy/Vercel edge). Without the flag, remoteAddress is used (safe default
  for direct exposure — prevents X-Forwarded-For spoofing by untrusted clients).

Authored-By: GSKNNFT

* fix(security): remove upstream tokens from browser API; propagate abort to custom runtime

HIGH — /api/studio: strip gatewayPrivate and localGatewayDefaultsPrivate from GET and
PUT responses. Upstream tokens must not cross the browser API boundary. The Studio
proxy (server/gateway-proxy.js) already injects the server-side token into connect
frames when the browser sends an empty token, so the browser never needed raw tokens.
GatewayClient.ts and OfficeScreen.tsx updated to work from sanitized public settings only.

MEDIUM — /api/runtime/custom route: pass request.signal to the upstream fetch() call.
Client abort (e.g. hitting Stop) now cancels the upstream runtime request instead of
leaving it running after the browser fetch resolves.

Authored By: GSKNNFT

* fix(security): preserve stored token through empty-token UI state; handle non-JSON health responses

GatewayClient.ts — autosave effects no longer overwrite persisted gateway tokens with
empty strings. When the in-memory token is empty (proxy handles auth server-side),
the patch omits the token field (undefined) so mergeGatewaySettings/mergeGatewayProfiles
treats it as "leave unchanged". adapterProfiles updater also preserves the existing
stored token when the new token is empty, preventing floor-switch from erasing tokens.

runtime/custom/http.ts — requestCustomRuntime() checks the response Content-Type before
calling response.json(). Non-JSON responses (e.g. plain-text /health "OK") are returned
as-is instead of throwing a JSON parse error, making the custom/local/claw3d health
probe path reliable for runtimes that return plain text.

Authored By: GSKNNFT

* fix(bug): avoid overwriting stored tokens with an empty UI value

GatewayClient.ts:944 → token: "" || undefined = undefined → omitted from patch
mergeGatewayConnectionState: patch.token === undefined → patchedToken = undefined → nextToken = undefined || current?.token ?? "" = "abc123" ✓

scenarionn- user explicitly clears token (empty string patch):

mergeGatewayConnectionState: patchedToken = "" → nextToken = "" || current?.token ?? "" = falls back to existing stored token

Authored By: GSKNNFT

* fix ongoing findings issue

* test: update gateway connection persistence expectations

Co-authored-by: Luke The Dev <iamlukethedev@users.noreply.github.com>

* fix: tighten ts.net hostname matching in doctor

Co-authored-by: Luke The Dev <iamlukethedev@users.noreply.github.com>

* chore(release): prepare v0.1.4

Pin in-repo app version to 0.1.4 to match the planned GitHub release
tag, and document the convergence release in CHANGELOG.md with verified
0.1.3 and 0.1.4 entries covering runtime profiles, multi-floor offices,
remote messaging/handoffs, file uploads, security hardening, and the
claw3doctor diagnostics CLI.

Made-with: Cursor

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Luke The Dev <iamlukethedev@users.noreply.github.com>
Co-authored-by: Elias Pfeffer <eliaspfeffer@gmail.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: Greg Clark <greg.clark@gmail.com>
Co-authored-by: iamlukethedev <lucas.guilherme@smartwayslfl.com>

2026-04-23 18:29:20 -05:00

9.8 KiB

Raw Blame History

Changelog

[0.1.4] - 2026-04-23

Runtime Profiles, Multi-Floor Offices, Remote Collaboration, and Diagnostics.

This release converges the runtime-profiles, office-systems, claw3doctor, and selective vera_lane work into one branch. Backends become named profiles, the office becomes a multi-floor building, remote offices gain server-backed messaging and handoffs, and a new diagnostics CLI makes setup and troubleshooting first-class.

Added

Named runtime profiles for openclaw, hermes, demo, local, claw3d, and custom backends, each storing its own URL and token in Studio settings instead of a single global pair (docs/runtime-profiles.md, src/lib/runtime/*).
Multi-floor office runtime model with one runtime binding per floor and persistent per-floor state, including lobby, openclaw-ground, hermes-first, local-runtime, claw3d-runtime, custom-second, training, traders-floor, and campus (src/lib/office/floors.ts, docs/office_sys/multi-floor-runtime-architecture.md).
Floor roster persistence and a floor navigation HUD for moving between runtime-backed floors in a single session (src/lib/office/floorRoster.ts, src/features/office/components/OfficeFloorNav.tsx, src/features/office/hooks/useOfficeFloorRuntimePersistence.ts).
Remote office messaging API for cross-office direct messages with structured assistant-history reply resolution (src/app/api/office/remote-message/route.ts).
Remote office handoff API for sending task / context / deliverables / acceptance criteria to a remote agent through the runtime layer (src/app/api/office/remote-handoff/route.ts, src/lib/runtime/agentMessaging.ts).
Local file upload route for chat attachments with allowlisted MIME types and a 10 MB upload cap (src/app/api/files/upload/route.ts).
claw3doctor diagnostics CLI with profile-scoped and --all-profiles runs, OpenClaw / Hermes / demo / custom-runtime probes, gateway failure classification, JSON output, and a npm run doctor script (scripts/claw3doctor.mjs, scripts/lib/claw3doctor-core.mjs, package.json).
New product and architecture docs covering runtime profiles, multi-floor architecture, the claw3doctor spec, runtime profile architecture, the refreshed roadmap, multi-agent beta, and the bulletin-board, desk-progression, hierarchy-and-teams, meeting-room-workflow, QA-department, and whiteboard specs (docs/).

Changed

Runtime provider selection is now profile-aware across openclaw, hermes, demo, local, claw3d, and custom instead of collapsing into one generic path (src/lib/runtime/createRuntimeProvider.ts, src/lib/runtime/{openclaw,hermes,demo,custom}/provider.ts).
Studio settings now persist per-profile URL/token entries and an active profile selection, with coordinated bootstrap and hydration paths (src/lib/studio/settings.ts, src/lib/studio/settings-store.ts, src/lib/studio/coordinator.ts).
Remote agent chat panel and remote office presence flows updated for the new server-backed delivery and reply behavior (src/features/office/components/RemoteAgentChatPanel.tsx, src/features/office/hooks/useRemoteOfficePresence.ts).
Hardened production security headers: strict CSP with 'unsafe-eval' only in dev, Referrer-Policy, X-Content-Type-Options, X-Frame-Options: SAMEORIGIN, restrictive Permissions-Policy, Cross-Origin-Resource-Policy: same-origin, and HSTS in production (next.config.ts).
Access gate rewritten with constant-time token comparison, a per-IP rate limiter (10 attempts / 60s), and TRUSTED_PROXY=1-gated X-Forwarded-For handling to prevent IP spoofing (server/access-gate.js).
Custom runtime provider and proxy URL handling tightened around runtime boundaries and allowlists (src/lib/runtime/custom/provider.ts, src/lib/gateway/proxy-url.ts).

Fixed

Repaired merge-corrupted files and removed tracked merge artifacts left over from the earlier overlapping branch stack.
Resolved a UTF-8 / Turbopack parsing issue and cleaned up Turbopack root and optional openclaw resolution warnings (next.config.ts).
Office navigation and pathfinding behavior tightened around floor-aware routing and runtime persistence (src/features/office/screens/OfficeScreen.tsx, src/features/retro-office/RetroOffice3D.tsx).

Tests

Added unit coverage for claw3doctor, office floors, floor roster, runtime connection, gateway connection, office floor runtime persistence, agent fleet hydration derivation, and studio settings coordinator behavior (tests/unit/).

Docs

Replaced top-level MULTI_AGENT_BETA.md and ROADMAP.md with stubs that point to canonical docs under docs/, and added a runtime profiles reference from README.md.
Expanded README.md to describe Local and Claw3D runtime modes and persistent backend profile configuration, including the additional local and claw3d values for CLAW3D_GATEWAY_ADAPTER_TYPE.

Notes

This release bumps the in-repo app version to 0.1.4. After merging, cut the GitHub release/tag as v0.1.4.
This is still an early-stage release. Remote office workflows, runtime profiles, multi-floor offices, and the diagnostics CLI will continue to iterate quickly in upcoming versions.

[0.1.3] - 2026-03-28

Remote Offices, Skills Marketplace, and Company Builder.

This release expands Claw3D from a single-office viewer into a more complete AI workplace, with guided setup, richer agent operations, remote office support, and stronger security hardening.

Added

New onboarding wizard for first-time setup, including gateway connection, prerequisites, company details, and initial agent configuration.
New packaged skills marketplace with trigger-driven office routing, including starter skills like Todo Board and SOUNDCLAW.
New office agent management wizard for creating and managing agents directly from the office experience.
New multi-agent beta support for remote office layouts, presence sync, and remote messaging.
New company builder wizard with AI-assisted organization generation and bootstrap planning.
Runtime gateway URL fallback through /api/studio for more reliable environment-specific setup.

Changed

Improved UI polish, responsiveness, and accessibility across the main app and office surfaces.
Hardened access control so gating applies across all routes, not only /api.
Enforced voice upload size limits before buffering.

Fixed

Closed multiple path traversal and file-path validation gaps in local file operations.
Resolved symlink handling issues in path suggestions.
Improved office navigation and pathfinding by fixing diagonal corner-cutting, metadata-driven blockers, collision-aware routing, and A* failure behavior.
Removed a TypeScript TS2367 build blocker in skillGymDirective.

Docs

Added an Agent Bus integration guide for visualizing AI sessions in Claw3D.
Refreshed the public roadmap.

Notes

This is still an early-stage release. The platform is moving quickly, especially around remote office workflows, skills, and guided setup, so expect rapid iteration in upcoming versions.

[0.1.2] - 2026-03-20

Added

An in-app avatar creator for agents with live 3D preview, appearance presets, and accessory controls for customizing office avatars.
A unified agent editor modal in the office that lets you edit avatars alongside agent brain files such as IDENTITY.md, SOUL.md, AGENTS.md, USER.md, TOOLS.md, MEMORY.md, and HEARTBEAT.md.
Structured avatar profile persistence and normalization so studio settings can store full avatar appearance data per gateway and agent instead of only avatar seeds.
A DEBUG environment toggle for controlling the OpenClaw event console in the office UI.

Changed

Reworked office avatar rendering so 3D agents reflect saved appearance profiles, including hair, clothing, hats, glasses, headsets, backpacks, and other visual variations.
Replaced avatar shuffle entry points in the chat and office surfaces with avatar customization flows that open the editor directly.
Updated the office HUD with a compact agent roster, overflow handling, and direct shortcuts into per-agent editing from the 3D office view.
Expanded the brain editor so IDENTITY.md fields are edited in structured form and agent renames can be applied to the live gateway agent after saving.
Defaulted the OpenClaw event console to a collapsed state and made it optional from environment configuration.
Updated hydration and store state to carry full avatar profiles through agent loading, persistence, and rendering.

Fixed

Fixed WebSocket gateway authentication during the upgrade handshake by wiring access control through the ws verifyClient flow.
Fixed the gym release directive TypeScript error by adding explicit "release" support to office gym directives and aligning release-hold logic.
Corrected studio settings merging and normalization for avatar data so saved office appearances survive reloads and patch updates.
Kept skill gym hold state active for release directives during office animation trigger reconciliation.

Tests

Added unit coverage for avatar profile persistence, studio settings normalization, and fleet hydration with structured avatar data.
Expanded end-to-end coverage for avatar settings fixtures, office header and sidebar flows, voice reply settings persistence, disconnected office settings surfaces, and office route expectations.

[0.1.1] - 2026-03-19

Added

Uploaded entire repo

[0.1.0] - 2026-03-16

Added

Initial public Claw3D project documentation, including README.md, VISION.md, and ARCHITECTURE.md.
A gateway-first web UI for connecting to OpenClaw agents, monitoring runtime activity, and managing agent workflows.
A retro-office 3D environment for visualizing agent activity, spatial interactions, and immersive operational surfaces.
An office builder flow for editing and publishing office layouts.

9.8 KiB Raw Blame History

Changelog

[0.1.4] - 2026-04-23

Added

Changed

Fixed

Tests

Docs

Notes

[0.1.3] - 2026-03-28

Added

Changed

Fixed

Docs

Notes

[0.1.2] - 2026-03-20

Added

Changed

Fixed

Tests

[0.1.1] - 2026-03-19

Added

[0.1.0] - 2026-03-16

Added

9.8 KiB

Raw Blame History