Hallucination rates are vanity. A model may pass one test but hit 30% errors on...

https://atavi.com/share/xujg73z1uos55

Hallucination rates are vanity. A model may pass one test but hit 30% errors on HalluHard. Because Vectara’s HHEM and AA-Omniscience measure facts differently, your yardstick is key