Evaluating the Robustness of Neural Networks: An Extreme Value...
Feb 15, 2018 · Our analysis yields a novel robustness metric called CLEVER, which is short for Cross Lipschitz Extreme Value for nEtwork Robustness. The proposed CLEVER score is …
While, as we mentioned earlier, there can be thorny “clever hans” issues about humans prompting LLMs, an automated verifier mechanically backprompting the LLM doesn’t suffer from these. …
579 In this paper, we have proposed a novel counter- factual framework CLEVER for debiasing fact- checking models. Unlike existing works, CLEVER is augmentation-free and mitigates …
Leaving the barn door open for Clever Hans: Simple features …
Dec 31, 2023 · This phenomenon, widely known in human and animal experiments, is often referred to as the 'Clever Hans' effect, where tasks are solved using spurious cues, often …
Submissions | OpenReview
Jan 22, 2025 · Leaving the barn door open for Clever Hans: Simple features predict LLM benchmark answers Lorenzo Pacchiardi, Marko Tesic, Lucy G Cheke, Jose Hernandez-Orallo …
Alias-Free Mamba Neural Operator | OpenReview
Sep 25, 2024 · To counteract the dilemma, we propose a mamba neural operator with O (N) computational complexity, namely MambaNO. Functionally, MambaNO achieves a clever …
Leaving the barn door open for Clever Hans: Simple features …
Sep 27, 2024 · This paper focuses on exploring the "Clever Hans" effect, also known as the "shortcut learning" effect, in which the trained model exploits simple and superficial …
D4: Improving LLM Pretraining via Document De-Duplication and...
Sep 25, 2023 · Our results indicate that clever data selection can significantly improve LLM pre-training, calls into question the common practice of training for a single epoch on as much data …
Right on Time: Revising Time Series Models by Constraining their ...
Sep 27, 2024 · The reliability of deep time series models is often compromised by their tendency to rely on confounding factors, which may lead to incorrect outputs. Our newly recorded, …
Thieves on Sesame Street! Model Extraction of BERT-based APIs
Dec 19, 2019 · Outputs of modern NLP APIs on nonsensical text provide strong signals about model internals, allowing adversaries to steal the APIs.