gg-hf-g

community
Activity Feed

AI & ML interests

None defined yet.

Recent Activity

lysandreย 
posted an update about 1 month ago
view post
Post
6234
We're kick-starting the process of Transformers v5, with @ArthurZ and @cyrilvallez !

v5 should be significant: we're using it as a milestone for performance optimizations, saner defaults, and a much cleaner code base worthy of 2025.

Fun fact: v4.0.0-rc-1 came out on Nov 19, 2020, nearly five years ago!
  • 6 replies
ยท
ariG23498ย 
posted an update about 2 months ago
view post
Post
904
New post is live!

This time we cover some major updates to transformers.

๐Ÿค—
  • 1 reply
ยท
danielhanchenย 
posted an update 2 months ago
view post
Post
5810
Run DeepSeek-V3.1 locally on 170GB RAM with Dynamic 1-bit GGUFs!๐Ÿ‹
GGUFs: unsloth/DeepSeek-V3.1-GGUF

The 715GB model gets reduced to 170GB (-80% size) by smartly quantizing layers.

The 1-bit GGUF passes all our code tests & we fixed the chat template for llama.cpp supported backends.

Guide: https://docs.unsloth.ai/basics/deepseek-v3.1
danielhanchenย 
posted an update 3 months ago
view post
Post
5101
Run OpenAI's new gpt-oss models locally with Unsloth GGUFs! ๐Ÿ”ฅ๐Ÿฆฅ
20b GGUF: unsloth/gpt-oss-20b-GGUF
120b GGUF: unsloth/gpt-oss-120b-GGUF

Model will run on 14GB RAM for 20b and 66GB for 120b.
  • 2 replies
ยท
danielhanchenย 
posted an update 3 months ago
ariG23498ย 
posted an update 3 months ago