TECP: Token-Entropy Conformal Prediction for LLMs

Uncertainty quantification (UQ) for open-ended language generation remains a critical yet underexplored challenge, particularly in settings where token-level log-probabilities are available during decoding. We present <b>Token-Entropy Conformal Prediction (TECP)</b>, which treats a log-p...

Full description

Bibliographic Details
Published in:Mathematics
Main Authors: Beining Xu, Yongming Lu
Format: Article
Language:English
Published: MDPI AG 2025-10-01
Subjects:
Online Access:https://www.mdpi.com/2227-7390/13/20/3351