DeepSeek had the same problem b4 V4 came out. Chinese AI labs due to compute issues seem to take longer time in pre-training new base model. GLM is going thru that grind now I think.
What changed
Can it deliver on its larger base model soon? DS's current cadence improvement is just so fast. — via @tphuang
Why it matters
Chinese AI labs face compute-driven pre-training delays, with GLM now in that grind.