NL-PAC: Specification Ambiguity and Certified Minimax Risk Floors in LLM-Mediated Supervision
The NL-PAC framework is introduced to address and quantify the risks of specification ambiguity when using large language models for labeling and evaluation tasks.