PowerCoder-3B is a retrained StarCoder2-3B, metamorphasized to use power retention with p=2.
The retraining dataset was the-stack-smol-v2 with FIM, reweighted to sample Python more frequently.
To get the power retention kernels, use pip install retention.
- Downloads last month
- 2,835
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support