R.I.P.
๐ป
Ghosted
Evaluating RAG for French immigration law: a benchmark and baseline study
July 27, 2026 ยท Grace Period ยท ๐ International workshop on AI for Human Resources and Public Employment Services (ECML-PKDD 2026)
Authors
Annia Abtout, Julien Delaunay, Monika Ewa Rakoczy
arXiv ID
2607.24449
Category
cs.IR: Information Retrieval
Cross-listed
cs.AI
Citations
0
Venue
International workshop on AI for Human Resources and Public Employment Services (ECML-PKDD 2026)
Abstract
International recruitment in France requires navigating a layered legal framework absent from existing legal AI benchmarks. We present a publicly available benchmark and first comparative evaluation for this domain, covering permit-type recommendation, required-document retrieval, and legal citation coverage. Comparing a parametric LLM baseline against dense retrieval augmentation at two model scales (Qwen3.5-9B and -27B) on 52 annotated synthetic profiles, we find that retrieval improves administrative guidance at both scales, most notably permit-type accuracy. Our results confirm that retrieval grounding is important for more reliable administrative guidance in this domain, and motivate further investigation of hybrid retrieval strategies.
Community Contributions
Found the code? Know the venue? Think something is wrong? Let us know!
๐ Similar Papers
In the same crypt โ Information Retrieval
๐
๐
Old Age
Neural Graph Collaborative Filtering
R.I.P.
๐ป
Ghosted
DeepFM: A Factorization-Machine based Neural Network for CTR Prediction
R.I.P.
๐ป
Ghosted
BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer
R.I.P.
๐
404 Not Found
Graph Neural Networks for Social Recommendation
R.I.P.
๐ป
Ghosted