Jet-Long: Efficient Long-Context Extension with Dynamic Bifocal RoPE

Jet-Long introduces a dynamic bifocal rotary position embedding method to efficiently extend the context window of large language models in a zero-shot manner.

Firefly links to the original publisher. The summary above is AI-generated for orientation and may differ from the source. The “current rank score” decays over time so newer significant stories surface first.