#423
createMixedStreamParser: keep line breaks and blank lines, and export a whole-text split that matches the stream
Version: @json-render/core 0.21.0
createMixedStreamParser calls onText(line) without the line break and skips blank lines entirely. The prose it rebuilds therefore differs from what createJsonRenderTransform streamed for the same text.
That matters for a server that saves the model's raw transcript, with its ```spec fences, and splits it into text and data-spec parts again when a conversation reloads. There is no exported function that gives exactly the parts the stream gave, so a reload can differ from what the user saw live.
Repro
Feed Here is your report.\n\n```spec\n{"op":"add","path":"/root","value":"report"}\n```\n\nLet me know. to both:
createJsonRenderTransformstreamsHere is your report.\n\n\nLet me know.as prose.createMixedStreamParsercallsonTextwithHere is your report.andLet me know.. Both line breaks and blank lines are gone.
Ask
- Keep the line break and blank lines in
onText. - Export a whole-text split, for example
splitSpecText(text) → { segments, invalid }, that gives exactly what the transform streams for the same text, with prose and patch segments in order.
Activity
0No activity yet.