Fine-tuned MiMo Audio to accept text/emotion captions (e.g. "intense fury, rage, hate") as input, trained a LoRA for 1k steps on LAION's voice acting dataset.
Thanks to HF for the GPUs to train ๐ค
mrfakename PRO
mrfakename
AI & ML interests
LLMs, TTS, & Open Source
Recent Activity
updated
a dataset
about 1 hour ago
mrfakename/udio-full
published
a dataset
about 2 hours ago
mrfakename/udio-full
replied to
their
post
about 7 hours ago
Trained a model for emotion-controllable TTS based on MiMo audio on LAION's dataset.
Still very early and does have an issue with hallucinating but results seem pretty good so far, given that it is very early into the training run.
Will probably kick off a new run later with some settings tweaked.
Put up a demo here: https://huggingface.co/spaces/mrfakename/EmoAct-MiMo
(Turn ๐ on to hear audio samples)
Organizations
replied to
their
post
about 7 hours ago
posted
an
update
about 23 hours ago
Post
691
Trained a model for emotion-controllable TTS based on MiMo audio on LAION's dataset.
Still very early and does have an issue with hallucinating but results seem pretty good so far, given that it is very early into the training run.
Will probably kick off a new run later with some settings tweaked.
Put up a demo here: mrfakename/EmoAct-MiMo
(Turn ๐ on to hear audio samples)
Still very early and does have an issue with hallucinating but results seem pretty good so far, given that it is very early into the training run.
Will probably kick off a new run later with some settings tweaked.
Put up a demo here: mrfakename/EmoAct-MiMo
(Turn ๐ on to hear audio samples)
-
- 3 replies
posted
an
update
7 months ago
Post
3541
Papla P1 from Papla Media is now available on the TTS Arena!
Try out Papla's new ultra-realistic TTS model + compare it with other leading models on the TTS Arena: TTS-AGI/TTS-Arena
Try out Papla's new ultra-realistic TTS model + compare it with other leading models on the TTS Arena: TTS-AGI/TTS-Arena
posted
an
update
7 months ago
Post
2965
GGUF quants (text-only) for the new Mistral Small 3.1 24B are now live:
mrfakename/mistral-small-3.1-24b-instruct-2503-gguf
mrfakename/mistral-small-3.1-24b-instruct-2503-gguf
posted
an
update
8 months ago
Post
2416
Converted the new Mistral Small 3.1 models to HF format (currently text-only, no vision):
Instruct: mrfakename/mistral-small-3.1-24b-instruct-2503-hf
Base: mrfakename/mistral-small-3.1-24b-base-2503-hf
GGUF quants coming soon!
Instruct: mrfakename/mistral-small-3.1-24b-instruct-2503-hf
Base: mrfakename/mistral-small-3.1-24b-base-2503-hf
GGUF quants coming soon!
posted
an
update
9 months ago
Post
2676
Iโm excited to introduce a new leaderboard UI + keyboard shortcuts on the TTS Arena!
The refreshed UI for the leaderboard is smoother and (hopefully) more intuitive. You can now view models based on a simpler win-rate percentage and exclude closed models.
In addition, the TTS Arena now supports keyboard shortcuts. This should make voting much more efficient as you can now vote without clicking anything!
In both the normal Arena and Battle Mode, press "r" to select a random text, Cmd/Ctrl + Enter to synthesize, and "a"/"b" to vote! View more details about keyboard shortcuts by pressing "?" (Shift + /) on the Arena.
Check out all the new updates on the TTS Arena:
TTS-AGI/TTS-Arena
The refreshed UI for the leaderboard is smoother and (hopefully) more intuitive. You can now view models based on a simpler win-rate percentage and exclude closed models.
In addition, the TTS Arena now supports keyboard shortcuts. This should make voting much more efficient as you can now vote without clicking anything!
In both the normal Arena and Battle Mode, press "r" to select a random text, Cmd/Ctrl + Enter to synthesize, and "a"/"b" to vote! View more details about keyboard shortcuts by pressing "?" (Shift + /) on the Arena.
Check out all the new updates on the TTS Arena:
TTS-AGI/TTS-Arena
- 1 reply
replied to
their
post
11 months ago
Hi, do you see a limit in the number of voices I have 416 and it fails to load all of them. (scroll menu limit?)
I'm not sure if there's a set limit for the dropdown, but with that many voices, it might make sense to not use the dropdown but instead have a textbox to specify the path to the reference speaker.
replied to
their
post
11 months ago
I don't think that's supported by the model, but you could fine-tune it or clone a voice with emotions. (I am not the author of the model itself, just of the web demo)
replied to
their
post
11 months ago
Hi,
You can upload a WAV file to the voices folder. Then, in the app.py file, add the filename of the voice (without .wav) to the voicelist list. It should show up in the Gradio demo.
replied to
their
post
11 months ago
Hi,
I added:
import nltk
nltk.download('punkt_tab')
and it seems to resolve the issue for me. Have you changed any code from the original Space?
Thanks!
replied to
their
post
11 months ago
This comment has been hidden
replied to
their
post
11 months ago
Hi,
Sorry about the issues! Please try adding:
nltk.download('punkt_tab')
below the nltk.download() line โ let me know if it works!
posted
an
update
about 1 year ago
Post
7880
I just released an unofficial demo for Moonshine ASR!
Moonshine is a fast, efficient, & accurate ASR model released by Useful Sensors. It's designed for on-device inference and licensed under the MIT license!
HF Space (unofficial demo): mrfakename/Moonshine
GitHub repo for Moonshine: https://github.com/usefulsensors/moonshine
Moonshine is a fast, efficient, & accurate ASR model released by Useful Sensors. It's designed for on-device inference and licensed under the MIT license!
HF Space (unofficial demo): mrfakename/Moonshine
GitHub repo for Moonshine: https://github.com/usefulsensors/moonshine
replied to
their
post
about 1 year ago
Training itself would be pretty easy, but the main issue would be data. AFAIK there's not much data out there for other TTS models. I synthetically generated the StyleTTS 2 dataset as it's quite efficient but other models would require much more compute.
reacted to
Jofthomas's
post with ๐ฅ
about 1 year ago
Post
7712
Everchanging Quest is out !
It is an LLM controlled Rogue-Like in which the LLM gets a markdown representation of the map, and should generate a JSON with the objective to fulfill on the map as well as the necessary objects and their placements.
Come test it on the space :
Jofthomas/Everchanging-Quest
It is an LLM controlled Rogue-Like in which the LLM gets a markdown representation of the map, and should generate a JSON with the objective to fulfill on the map as well as the necessary objects and their placements.
Come test it on the space :
Jofthomas/Everchanging-Quest
- 2 replies
reacted to
cdminix's
post with ๐
over 1 year ago
Post
2257
Since new TTS (Text-to-Speech) systems are coming out what feels like every day, and it's currently hard to compare them, my latest project has focused on doing just that.
I was inspired by the TTS-AGI/TTS-Arena (definitely check it out if you haven't), which compares recent TTS system using crowdsourced A/B testing.
I wanted to see if we can also do a similar evaluation with objective metrics and it's now available here:
ttsds/benchmark
Anyone can submit a new TTS model, and I hope this can provide a way to get some information on which areas models perform well or poorly in.
The paper with all the details is available here: https://arxiv.org/abs/2407.12707
I was inspired by the TTS-AGI/TTS-Arena (definitely check it out if you haven't), which compares recent TTS system using crowdsourced A/B testing.
I wanted to see if we can also do a similar evaluation with objective metrics and it's now available here:
ttsds/benchmark
Anyone can submit a new TTS model, and I hope this can provide a way to get some information on which areas models perform well or poorly in.
The paper with all the details is available here: https://arxiv.org/abs/2407.12707
Congratulations!
reacted to
not-lain's
post with ๐ค
over 1 year ago
Post
7836
I am now a huggingface fellow ๐ฅณ
-
- 15 replies
reacted to
lunarflu's
post with ๐ฅ
over 1 year ago
Post
2108
cooking up something....anyone interested in a daily activity tracker for HF?
- 12 replies