Qwen 27B models descend from the 9B: repeated layers, looped Transformers, and a JetBrains blend

Qwen 27B models descend from the 9B: repeated layers, looped Transformers, and a JetBrains blend

On October 28, Jonathan Chang showed that Qwen3.5-27B was grown from the 9B by repeating its layers. A paper from IBM Research makes looped Transformers much less memory-intensive. JetBrains got a good code model by simply averaging Qwen 3.6 and 3.8.

veille

This is a short excerpt.

The full analysis and podcast are for subscribers. The account is free.

Sign in

No account yet?

← All the watch