A preprint posted on arXiv on Oct. 14 describes WUSPruner, a structured pruning method for large language models, which the paper says chooses a basis for coordinate deletion to reduce reconstruction loss.
The claim matters because structured pruning aims to cut model dimensions to lower inference cost, and the paper says its method improves over structured-pruning baselines on Llama and Qwen models while reducing latency and memory use. The arXiv posting provides no independent test results or peer review.
According to the abstract, WUSPruner treats basis selection as a local linear reconstruction problem and builds a WUS transform from activation and weight statistics. The authors write that, under positive-definite second moments, the WUS transform minimizes local reconstruction loss over invertible changes of basis, and that in the resulting basis the activation and weight second moments are simultaneously diagonalized and balanced.
The abstract says the method uses blockwise WUS transformations and compact input projections to make pruning scalable, and reports experiments on Llama and Qwen models ranging from 8B to 72B parameters across language modeling, knowledge, commonsense reasoning, mathematics and code generation benchmarks. It does not include benchmark tables, model configurations, pruning ratios or latency test conditions in the arXiv summary.
The arXiv record, in the machine learning category, lists an arXiv-issued DOI as pending registration through DataCite.