Breaking

Developer Builds Gesture-Controlled 3D 'Second Brain' Using Obsidian and Hermes Agent

July 12, 2026 at 01:15 EDT

AI Agents
Open Source

A developer has combined the note-taking app Obsidian with the open-source Hermes Agent framework to build an experimental 3D "second brain" that can be navigated by hand—letting a user reach out and physically move through their own knowledge in space.

Mid-July 2026 · Experimental Demo

Reaching Into Your Own Mind: A Hand-Navigated 3D "Second Brain"

A developer fused the Obsidian note-taking app with the open-source Hermes Agent framework to project a personal knowledge vault into 3D space — grabbed and steered with bare-hand gestures.

distinct visualizations: radial, clustered topology & semantic network

~30min

to get the base Hermes + Obsidian setup running

underlying tools: Obsidian is free & local, Hermes Agent is open source

From flat graph to embodied space

How far each approach takes navigation of your notes — the demo pushes to a new level.

2D graph

flat view of links

+ AI memory

persistent, reasoning layer

3D + gesture

reach in & move through

How the pieces fit together

Obsidian vault

local Markdown notes & bidirectional links

→

Hermes Agent

semantic parsing, memory & relationship mapping

→

3D + hand tracking

nodes & edges you grab and steer by gesture

Why it's compelling

Makes an AI memory layer visual and physically manipulable — "memory that survives after the chat closes" and a system that "learns me back," with automatic indexing and long-term context.

What we still don't know

A personal, unpublished experiment — no benchmarks, price, or release date. The 3D build's details aren't public and the gesture version hasn't been independently evaluated.

Continue reading

The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.