Jet-Long: Efficient Long-Context Extension with Dynamic Bifocal RoPE
Jet-Long introduces a dynamic bifocal rotary position embedding method to efficiently extend the context window of large language models in a zero-shot manner.
Jet-Long introduces a dynamic bifocal rotary position embedding method to efficiently extend the context window of large language models in a zero-shot manner.
A new auditing technique called overthinking uses task vectors to amplify a model's reasoning process, helping to expose hidden information or misaligned behaviors.
The paper presents MultiSim, an ensemble approach that utilizes multiple driving simulators to identify and mitigate testing discrepancies in automated driving assistance systems.
This paper addresses feature entanglement in language models by proposing a method to encourage almost orthogonal features, enabling more precise and isolated mechanistic interventions.
A new study reveals that training models on data following a power-law distribution, rather than a curated uniform distribution, actually improves their ability to perform compositional reasoning tasks.
Chinese memory chip manufacturer ChangXin Memory Technologies has initiated its STAR Market IPO process to raise 29.5 billion RMB.
Qatari IT service provider Meeza has completed a data center expansion project for an unnamed major hyperscale cloud provider ahead of schedule.
Researchers have demonstrated that hackers can exploit security vulnerabilities in popular large language models to construct large-scale botnets through a technique called HalluSquatting.
Alibaba's stock price rose significantly in Hong Kong following optimistic analyst projections for revenue growth driven by rising demand for artificial intelligence and its proprietary T-Head chips.
This paper compares softmax attention with four recurrent linear-attention architectures to analyze their mechanisms and trade-offs for long-context processing.
Omni-Sleep is a new foundation model designed to analyze sleep physiology by modeling the coordinated dynamics of the central and autonomic nervous systems.
The paper introduces TAG, a lightweight framework designed to improve the reliability of LLM-generated structured artifacts through rigorous, test-driven validation.
The ABot-C0 technical report details a new framework for quadrupedal robot control designed to overcome the scarcity of animal motion-capture data.
The Echoes dataset provides over 130 hours of audio across multiple genres to benchmark and train robust music deepfake detection systems.
Researchers have introduced ParamMute, a method that improves the faithfulness of retrieval-augmented generation by suppressing knowledge-critical feed-forward networks that cause models to ignore retrieved context.
Researchers have found that persuasion-based jailbreak attacks can undermine the effectiveness of chain-of-thought monitoring in detecting misaligned AI behavior.
The V-VLAPS framework integrates value-guided planning with vision-language-action models to improve robotic manipulation performance under distribution shifts and long-horizon tasks.
This position paper argues that current retrieval-augmented generation systems are overly focused on factual grounding and fail to adequately represent diverse opinions.
VocaDet is a new open-vocabulary object detection and segmentation framework that scales to large object categories using visual tokenization and vector database retrieval.
Researchers developed TRACE, a robust watermarking method designed to protect and verify the attribution of LLM agent trajectory logs against unauthorized rebranding or model substitution.
GitLake introduces a version-control system for data lakehouses that allows autonomous AI agents to work on isolated branches before merging changes.
KeyBanc Capital Markets downgraded Apple's stock rating to underweight, citing concerns over demand and high valuation relative to historical averages.
Driven by the massive energy demands of artificial intelligence, China's private nuclear fusion sector is accelerating development toward a 2030 power generation goal.
The study demonstrates how frontier AI models can be used to reason through reaction networks and generate experimentally validated hypotheses for catalyst selectivity.