Miércoles 4 de noviembre de 2026 ·

Cambiar el juez cambia el ranking: estudio preregistrado de replicación entre proveedores en comparaciones de sistemas evaluados por LLM

Computer Science > Computation and Language Title:Swapping the Judge Changes the Ranking: A Preregistered Study of Cross-Provider Replication in LLM-Judged System Comparisons View PDF HTML (experimental)Abstract:Practitioners who compare systems with an LLM judge and have no human labels often check a conclusion by repeating it with a judge from another provider. In a preregistered study (with a disclosed post-registration reduction of the judge set), five judge models from three providers re-judged 4,000 Chatbot Arena battles (nine systems, 33 system pairs) that carry human votes, each in bot

Fuentes originales

Resumen de Hoy en IA. Pulsa una fuente para leer la noticia completa en su idioma original.

También ese día

Todas las noticias de IA del miércoles 4 de noviembre de 2026 ->