Hugging Face's logo
Piotr Wilkin's picture
22 1

Piotr Wilkin

ilintar
fearlessdots's profile picture spooner2's profile picture Doctor-Chad-PhD's profile picture
·

AI & ML interests

None yet

Recent Activity

reacted to onekq's post with 👍 1 day ago
Context rot is such a catchy phrase, but the problem has been identified 2+ years ago, called attention decay. https://huggingface.co/papers/2307.03172 I spotted the same problem in coding tasks, and documented in my book (https://www.amazon.com/dp/9999331130). Why did this problem become hot again? This is because many of us thought the problem has been solved by long context models, which is not true. Here we were misled by benchmarks. Most long-context benchmarks build around the QA scenario, i.e. "finding needle in haystack". But in agentic scenarios, the model needs to find EVERYTHING in the haystack, and just can't afford enough attention for this challenge.
updated a model 1 day ago
ilintar/Qwen3-Next-80B-A3B-Instruct-GGUF
new activity 4 days ago
ilintar/Qwen3-Next-80B-A3B-Instruct-GGUF:Fix model name (not A30B, but A3B)
View all activity

Organizations

Syndatis Ltd.'s profile picture Hugging Face Discord Community's profile picture