Reverse Engineering User Stories from Code using Large Language Models

September 23, 2025 Β· Declared Dead Β· πŸ› Conference of the Centre for Advanced Studies on Collaborative Research

πŸ‘» CAUSE OF DEATH: Ghosted
No code link whatsoever

"No code URL or promise found in abstract"

Evidence collected by the PWNC Scanner

Authors Mohamed Ouf, Haoyu Li, Michael Zhang, Mariam Guizani arXiv ID 2509.19587 Category cs.SE: Software Engineering Cross-listed cs.AI Citations 0 Venue Conference of the Centre for Advanced Studies on Collaborative Research Last Checked 5 months ago
Abstract
User stories are essential in agile development, yet often missing or outdated in legacy and poorly documented systems. We investigate whether large language models (LLMs) can automatically recover user stories directly from source code and how prompt design impacts output quality. Using 1,750 annotated C++ snippets of varying complexity, we evaluate five state-of-the-art LLMs across six prompting strategies. Results show that all models achieve, on average, an F1 score of 0.8 for code up to 200 NLOC. Our findings show that a single illustrative example enables the smallest model (8B) to match the performance of a much larger 70B model. In contrast, structured reasoning via Chain-of-Thought offers only marginal gains, primarily for larger models.
Community shame:
Not yet rated
Community Contributions

Found the code? Know the venue? Think something is wrong? Let us know!

πŸ“œ Similar Papers

In the same crypt β€” Software Engineering

Died the same way β€” πŸ‘» Ghosted