Article
Sparse Mixture of Experts Language Model from Scratch: Extending makeMoE with Expert Capacity
By
•
•
13Thierry Herrmann
thierryh
AI & ML interests
deep learning, machine learning
Organizations
None yet
upvoted
2
articles
2 months ago
Article
makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch
By
•
•
102
upvoted
3
articles
6 months ago
Article
Train 400x faster Static Embedding Models with Sentence Transformers
•
216
Article
Training and Finetuning Embedding Models with Sentence Transformers v3
•
257
Article
Training and Finetuning Reranker Models with Sentence Transformers v4
•
167
upvoted
an
article
7 months ago
Article
Faster Text Generation with Self-Speculative Decoding
•
62
upvoted
3
articles
8 months ago
Article
Controlling Language Model Generation with NVIDIA's LogitsProcessorZoo
•
49
Article
Visualize and understand GPU memory in PyTorch
•
248
Article
From PyTorch DDP to 🤗 Accelerate to 🤗 Trainer, mastery of distributed training with ease
•
40