Ephemerent News https://ephemerent.com/news Research briefings, technology, and evidence. en-us Tue, 11 Aug 2026 12:00:00 -0400 https://ephemerent.com/assets/og-news-drfsp.png Ephemerent News https://ephemerent.com/news A simpler rule beat the hierarchy on GPT-2. Here’s what that means. https://ephemerent.com/news/drfsp-robust-compression https://ephemerent.com/news/drfsp-robust-compression Sun, 09 Aug 2026 12:00:00 -0400 hello@ephemerent.com (Kenju Tomita) Research Dispatch Neural network compression A controlled experiment rewarded a sophisticated compression hierarchy. A small GPT-2 test did not. The reversal became the real result. I built a sophisticated hierarchy to compress neural networks without erasing rare-domain behavior. It worked perfectly in a controlled setting. On GPT-2, a much simpler robust baseline did better at aggressive compression—and that became the real result.

Read the full Research Dispatch at Ephemerent News.

Open the peer-reviewed research record at Ephemerent Research.

]]>