跳到正文

GPT-6 Astra can edit Qwen3.5-0.8B’s weights and raise its MATH-500 from 7.9% to 48.1%, without gradients or retraining.

摘要

alphaXiv 转述 MIT 的一篇博客,称 GPT-6 Astra 能在不计算梯度、不重新训练的情况下直接读取并编辑 Qwen3.5-0.8B 的权重,使其 MATH-500 成绩从 7.9% 提升到 48.1%。

摘要由模型根据原文撰写,以原文为准。

正文 · 原文

GPT-6 Astra can edit Qwen3.5-0.8B’s weights and raise its MATH-500 from 7.9% to 48.1%, without gradients or retraining.

“Sparks of Weight-Space Programming”

This blog from MIT asks whether LLMs can read and edit neural network weights directly, much like code.

In Qwen, Astra traced repetitive reasoning loops to a direction written by two MLP layers, then edited the weights to suppress it.

With 50 batches of forward-pass feedback, the fix also raised instruction following from 21.0% to 62.3%

Read on alphaXiv: https://www.alphaxiv.org/abs/2611.weight-space-programming

来源:alphaXiv · x.com

引用原文

askalphaxiv. GPT-6 Astra can edit Qwen3.5-0.8B’s weights and raise its MATH-500 from 7.9% to 48.1%, without gradients or retraining.[EB/OL]. (2026-11-03)[访问日期]. https://x.com/askalphaxiv/status/2117406632229646689.