Search-based Optimisation of LLM Learning Shots for Story Point Estimation

March 13, 2024 Β· Declared Dead Β· πŸ› International Symposium on Search Based Software Engineering

πŸ‘» CAUSE OF DEATH: Ghosted
No code link whatsoever

"No code URL or promise found in abstract"

Evidence collected by the PWNC Scanner

Authors Vali Tawosi, Salwa Alamir, Xiaomo Liu arXiv ID 2403.08430 Category cs.SE: Software Engineering Cross-listed cs.AI Citations 11 Venue International Symposium on Search Based Software Engineering Last Checked 4 months ago
Abstract
One of the ways Large Language Models (LLMs) are used to perform machine learning tasks is to provide them with a few examples before asking them to produce a prediction. This is a meta-learning process known as few-shot learning. In this paper, we use available Search-Based methods to optimise the number and combination of examples that can improve an LLM's estimation performance, when it is used to estimate story points for new agile tasks. Our preliminary results show that our SBSE technique improves the estimation performance of the LLM by 59.34% on average (in terms of mean absolute error of the estimation) over three datasets against a zero-shot setting.
Community shame:
Not yet rated
Community Contributions

Found the code? Know the venue? Think something is wrong? Let us know!

πŸ“œ Similar Papers

In the same crypt β€” Software Engineering

Died the same way β€” πŸ‘» Ghosted