#7

Related work: empirical agent-side validation of MDXG's dual-audience premise

Openguillaume-hestia-projektopened 5mo ago

Hi MDXG team — sharing a small piece of related work in case it's useful to the community. No specific ask.

We tested whether the dual-audience premise from your README — "markdown is the primary interface between humans and AI agents […] markdown is already ideal for agents: low token cost, simple to generate, trivial to parse. The missing piece is the human side" — holds empirically on the agent side.

Setup: 558 atomic claims projected as <entity_id>/<predicate>.md files (one fact per file, literal value as body). One model (Sonnet 4.6) in Claude Code (--print), three retrievers in isolation, 28 auto-verifiable questions:

  • R1 — SQL exact on the source Postgres
  • R2 — MCP grep tool (JSON inline)
  • R3 — grep / ls / cat / find on the markdown projection

Findings: R3 (file-grep on the projection) wins on precision (71% exact-match vs 68% / 57%), latency (34s vs 22s / 99s), and runtime robustness (0 errors vs 0 / 5 for SQL). The agent side of the dual-audience model just works with stock Unix tools — on the same files you spec for human consumption.

The paper's §5.7 "Related work — MDXG" credits the spec explicitly and quotes the motivation line above. Any .md produced by our projection script is MDXG-conformant by construction; a viewer like @mdxg/vscode opened on the same tree would give operators the polished navigation MDXG specifies, while agents grep in parallel. One substrate, two consumers.

Figured the empirical agent-side confirmation might interest the MDXG community. Happy to close if off-topic for the issue tracker — Discussions aren't enabled so this was the only available channel.

Activity

0

No activity yet.