A collection of Lama and TinyLlama models converted for use with RK3588 single board computers.
James Callander
jamescallander
AI & ML interests
Interested in AI and machine learning for bioinformatics, marine water chemistry analysis, and automation.
Recent Activity
updated
a model
about 2 months ago
jamescallander/gemma-3-270m-it_w8a8_g128_rk3588.rkllm
updated
a model
about 2 months ago
jamescallander/NextCoder-7B_w8a8_g128_rk3588.rkllm
updated
a model
3 months ago
jamescallander/DeepSeek-R1-Distill-Qwen-1.5B_w8a8_g128_rk3588.rkllm
Organizations
None yet
RK3588 Gemma Models
A collection of gemma models converted for use on RK3588 development boards.
-
jamescallander/txgemma-9b-chat_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 3 -
jamescallander/medgemma-4b-it_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 2 -
jamescallander/gemma-2-2b-it_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 12 -
jamescallander/gemma-3-4b-it_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 22
RK3588 Chat & Instruction Models
Chat and instruction models converted to the rkllm format for use with RK3588 single board computers.
-
jamescallander/deepseek-llm-7b-chat_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 42 -
jamescallander/Llama-3.1-8B-Instruct_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 16 -
jamescallander/MiniCPM4-0.5B_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 18 -
jamescallander/TinyLlama-1.1B-Chat-v1.0_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 21 • 1
RK3588 Biomedical Models
A collection of biomedical models converted for use with RK3588 single board computers.
-
jamescallander/txgemma-9b-chat_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 3 -
jamescallander/MediPhi-Instruct_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 5 -
jamescallander/MediPhi-PubMed_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 7 -
jamescallander/medgemma-4b-it_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 2
RK3588 Math and Science Models
A collection of math and science models converted for use on RK3588 single board computers.
-
jamescallander/Qwen2.5-Math-7B-Instruct_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 11 -
jamescallander/Qwen2.5-Math-1.5B-Instruct_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 12 -
jamescallander/qwen2-5_convos__SCP_org_chemistry_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 5 -
jamescallander/medgemma-4b-it_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 2
RK3588 DeepSeek models
DeepSeek models converted to the rkllm format for use with RK3588 single board computers.
-
jamescallander/DeepSeek-R1-Distill-Qwen-14B_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 5 -
jamescallander/DeepSeek-R1-Distill-Llama-8B_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 7 -
jamescallander/DeepSeek-R1-Distill-Qwen-1.5B_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 25 -
jamescallander/deepseek-llm-7b-chat_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 42
RK3588 Coding Models
Coding models converted to the rkllm format for use with RK3588 single board computers.
-
jamescallander/NextCoder-7B_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 11 • 1 -
jamescallander/Qwen2.5-Coder-3B-Instruct_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 13 • 1 -
jamescallander/deepseek-coder-1.3b-instruct_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 9 -
jamescallander/CodeLlama-7b-Instruct-hf_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 17
RK3588 rkllm Models
Converted models for use on RK3588 single board computers such as Radxa Rock 5b+, Orange Pi 5 plus, Banana Pi M7, etc.
-
jamescallander/deepseek-llm-7b-chat_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 42 -
jamescallander/txgemma-9b-chat_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 3 -
jamescallander/NextCoder-7B_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 11 • 1 -
jamescallander/Qwen2.5-Math-1.5B-Instruct_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 12
RK3588 Llama and TinyLlama Models
A collection of Lama and TinyLlama models converted for use with RK3588 single board computers.
RK3588 Math and Science Models
A collection of math and science models converted for use on RK3588 single board computers.
-
jamescallander/Qwen2.5-Math-7B-Instruct_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 11 -
jamescallander/Qwen2.5-Math-1.5B-Instruct_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 12 -
jamescallander/qwen2-5_convos__SCP_org_chemistry_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 5 -
jamescallander/medgemma-4b-it_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 2
RK3588 Gemma Models
A collection of gemma models converted for use on RK3588 development boards.
-
jamescallander/txgemma-9b-chat_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 3 -
jamescallander/medgemma-4b-it_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 2 -
jamescallander/gemma-2-2b-it_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 12 -
jamescallander/gemma-3-4b-it_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 22
RK3588 DeepSeek models
DeepSeek models converted to the rkllm format for use with RK3588 single board computers.
-
jamescallander/DeepSeek-R1-Distill-Qwen-14B_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 5 -
jamescallander/DeepSeek-R1-Distill-Llama-8B_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 7 -
jamescallander/DeepSeek-R1-Distill-Qwen-1.5B_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 25 -
jamescallander/deepseek-llm-7b-chat_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 42
RK3588 Chat & Instruction Models
Chat and instruction models converted to the rkllm format for use with RK3588 single board computers.
-
jamescallander/deepseek-llm-7b-chat_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 42 -
jamescallander/Llama-3.1-8B-Instruct_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 16 -
jamescallander/MiniCPM4-0.5B_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 18 -
jamescallander/TinyLlama-1.1B-Chat-v1.0_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 21 • 1
RK3588 Coding Models
Coding models converted to the rkllm format for use with RK3588 single board computers.
-
jamescallander/NextCoder-7B_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 11 • 1 -
jamescallander/Qwen2.5-Coder-3B-Instruct_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 13 • 1 -
jamescallander/deepseek-coder-1.3b-instruct_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 9 -
jamescallander/CodeLlama-7b-Instruct-hf_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 17
RK3588 Biomedical Models
A collection of biomedical models converted for use with RK3588 single board computers.
-
jamescallander/txgemma-9b-chat_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 3 -
jamescallander/MediPhi-Instruct_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 5 -
jamescallander/MediPhi-PubMed_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 7 -
jamescallander/medgemma-4b-it_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 2
RK3588 rkllm Models
Converted models for use on RK3588 single board computers such as Radxa Rock 5b+, Orange Pi 5 plus, Banana Pi M7, etc.
-
jamescallander/deepseek-llm-7b-chat_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 42 -
jamescallander/txgemma-9b-chat_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 3 -
jamescallander/NextCoder-7B_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 11 • 1 -
jamescallander/Qwen2.5-Math-1.5B-Instruct_w8a8_g128_rk3588.rkllm
Text Generation • Updated • 12