Unlike existing AI writing tools that focus on text generation, the system aims to tackle the full intellectual workflow of academic paper creation—from organizing raw materials to generating figures and conducting literature reviews.
The system employs five specialized agents working in parallel: Outline Agent, Plotting Agent, Literature Review Agent, Section Writing Agent, and Content Refinement Agent. Each agent handles specific aspects of manuscript preparation, from structuring arguments to creating visualizations and ensuring proper academic citations through API-grounded references.
To evaluate performance, researchers created PaperWritingBench, the first standardized benchmark reverse-engineered from 200 top-tier AI conference papers. In side-by-side human evaluations, researchers noted, PaperOrchestra achieved win rate margins of 50%-68% for literature review quality and 14%-38% for overall manuscript quality compared to autonomous baselines.
