Evaluating RAG for French immigration law: a benchmark and baseline study

July 27, 2026 ยท Grace Period ยท ๐Ÿ› International workshop on AI for Human Resources and Public Employment Services (ECML-PKDD 2026)

โณ Grace Period
This paper is less than 90 days old. We give authors time to release their code before passing judgment.
Authors Annia Abtout, Julien Delaunay, Monika Ewa Rakoczy arXiv ID 2607.24449 Category cs.IR: Information Retrieval Cross-listed cs.AI Citations 0 Venue International workshop on AI for Human Resources and Public Employment Services (ECML-PKDD 2026)
Abstract
International recruitment in France requires navigating a layered legal framework absent from existing legal AI benchmarks. We present a publicly available benchmark and first comparative evaluation for this domain, covering permit-type recommendation, required-document retrieval, and legal citation coverage. Comparing a parametric LLM baseline against dense retrieval augmentation at two model scales (Qwen3.5-9B and -27B) on 52 annotated synthetic profiles, we find that retrieval improves administrative guidance at both scales, most notably permit-type accuracy. Our results confirm that retrieval grounding is important for more reliable administrative guidance in this domain, and motivate further investigation of hybrid retrieval strategies.
Community shame:
Not yet rated
Community Contributions

Found the code? Know the venue? Think something is wrong? Let us know!

๐Ÿ“œ Similar Papers

In the same crypt โ€” Information Retrieval