White House · Anthropic · China · U.S. · U.S. Treasury · TechCrunch AI
Experts say exploiting Anthropic’s Fable isn’t how Kimi K3 got so good
Compiled by KHAO Editorial — aggregated from 1 source. See llms.txt for citation guidance.
◌ Single Source
White House science advisor Michael Kratsios said that Moonshot, the Chinese company behind Kimi K3, the largest available open-weight LLM, built its model by copying Anthropic’s Fable LLM while using chips that aren’t cleared for export to China.
Key facts
- President Joe Biden’s Department of Commerce proposed federal know-your-customer rules for data centers in 2024, but no further progress appears to have been made under Donald Trump
- White House science advisor Michael Kratsios said that Moonshot, the Chinese company behind Kimi K3, the largest available open-weight LLM, built its model by copying Anthropic’s Fable LLM
- I don’t think you get a model this strong and this quickly on the heels of Fable doing strictly distillation,” Braden Hancock, a researcher at the Laude Institute and co-founder of Snorkel AI, told
- But Lambert says that the benefits of SFT are becoming less important as models become more complex
Summary
“Large-scale, covert industrial distillation aimed at stealing proprietary U.S. technology and undermining American research is unacceptable,” Kratsios wrote, amid reported discussions about banning Chinese open-weight models that have roiled the AI sector. Kratsios’ tweet echoed comments from Treasury Secretary Scott Bessent that “we are finding watermarks of our U.S. large language models on many of the Chinese models, and that that’s unacceptable.” It’s not clear what those watermarks consist of, and the Treasury Department did not respond to a query. However, experts are skeptical that distillation, the process of querying an LLM to determine its inner workings and copy its capabilities, is responsible for the advanced capabilities that Kimi K3 displays.