Hugging Face's logo
mindstate's picture
51

mindstate

mindstate
RickRossTN's profile picture samunder12's profile picture
·

AI & ML interests

None yet

Recent Activity

liked a model about 5 hours ago
Overworld/Waypoint-1-Small
updated a collection about 8 hours ago
Lightweight
reacted to codelion's post with 🔥 about 8 hours ago
Reverse Engineering a $500M Mystery: From HashHop to Memory-Augmented Language Models I wrote a deep dive into how Magic AI's 100M token context window might work, starting from their HashHop benchmark and building up to MALM - a Memory-Augmented Language Model. Key insight: treating each key as a single token enables perfect retrieval at unlimited context lengths. The article covers: - How HashHop works and why its perfect accuracy is suspicious - Building a tokenized solver that achieves 100% accuracy - Scaling to MALM for real code search tasks - Why this approach could handle 100M+ tokens Read the full article: https://huggingface.co/blog/codelion/reverse-engineering-magic-hashhop Try the model: https://huggingface.co/codelion/malm-165m Code: https://github.com/codelion/hash-hop
View all activity

Organizations

None yet