ALTERNATIVES

Best llama.cpp alternatives

AI tools that cover similar ground to llama.cpp, sorted by relevance. Use the table for a quick pricing and category check, then click through for details.

ToolPricingCategoriesBest for
LangGPTFreePrompts / AI Open SourceStructured prompt framework from China
易标 OpenBidKitFreeBid Writing / AI Open SourceOpen-source AI bid writing toolkit
魔搭 ModelScopeFreeArt Models / AI Open Platforms / Dev Communities / AI Open SourceAlibaba's open-source model community
Label StudioFreemiumData Labeling / AI Open SourceMost popular open-source data labeling tool
CVATFreemiumData Labeling / AI Open SourceOpen-source CV annotation industry standard
GPT-SoVITSFreeVoice Cloning / AI Open SourceOpen-source voice cloning star: few-shot cloning from seconds of audio
RIME 小狼毫FreeAI Input Methods / AI Open SourceOpen-source keyboard engine adored by geeks and power users
AnythingLLMFreemiumKnowledge Base / AI Open SourceOpen-source app to chat with your docs using any LLM

How we picked these alternatives

We only include tools that share at least one category with llama.cpp. Ordering is relevance-based, not paid: featured tools first, then the rest of the category.

Free
LangGPT
LangGPT

Structured prompt framework from China

PromptsAI Open Source
Free
易标 OpenBidKit
易标 OpenBidKit

Open-source AI bid writing toolkit

Bid WritingAI Open Source
Free
魔搭 ModelScope
魔搭 ModelScope

Alibaba's open-source model community

Art ModelsAI Open Platforms
Freemium
Label Studio
Label Studio

Most popular open-source data labeling tool

Data LabelingAI Open Source
Freemium
CVAT
CVAT

Open-source CV annotation industry standard

Data LabelingAI Open Source
Free
GPT-SoVITS
GPT-SoVITS

Open-source voice cloning star: few-shot cloning from seconds of audio

Voice CloningAI Open Source
Free
RIME 小狼毫
RIME 小狼毫

Open-source keyboard engine adored by geeks and power users

AI Input MethodsAI Open Source
Freemium
AnythingLLM
AnythingLLM

Open-source app to chat with your docs using any LLM

Knowledge BaseAI Open Source
Freemium
MiniMax
MiniMax

China's AI tiger behind Hailuo, full-modal LLMs

LLMsAI Chat
Freemium
百川智能 Baichuan
百川智能 Baichuan

Baichuan open-source LLMs by Sogou founder Wang Xiaochuan

LLMsAI Open Source
Freemium
零一万物 01.AI
零一万物 01.AI

Kai-Fu Lee's 01.AI, maker of Yi open models

LLMsAI Open Source
Freemium
阶跃星辰 StepFun
阶跃星辰 StepFun

StepFun's Step series: strong multimodal open models

LLMsAI Chat
Freemium
讯飞星火 SparkDesk
讯飞星火 SparkDesk

iFlytek Spark Desk, LLM with top speech tech

LLMsAI Chat
Freemium
天工 Skywork
天工 Skywork

Kunlun's Skywork: prolific open-source LLM family

LLMsAI Open Source
Free
书生·浦语 InternLM
书生·浦语 InternLM

InternLM open LLMs from Shanghai AI Laboratory

LLMsAI Open Source
Free
面壁智能 MiniCPM
面壁智能 MiniCPM

MiniCPM: powerful small LLMs that run on your phone

LLMsEdge AI
Freemium
AI21 Labs
AI21 Labs

Israeli NLP pioneer behind Jamba open models

LLMs
Freemium
Reka AI
Reka AI

Multimodal LLM startup by ex-DeepMind researchers

LLMs
Free
LLaMA-Factory
LLaMA-Factory

Zero-code fine-tuning for 100+ open LLMs

Model TrainingAI Open Source
Freemium
Unsloth
Unsloth

2x faster LLM fine-tuning with 70% less VRAM

Model TrainingAI Open Source
Free
Axolotl
Axolotl

Config-driven LLM fine-tuning tool

Model TrainingAI Open Source
Free
ColossalAI
ColossalAI

Distributed deep learning framework for big models

Model TrainingAI Open Source
Free
DeepSpeed
DeepSpeed

Microsoft's library for training giant models

Model TrainingAI Open Source
Free
飞桨 PaddlePaddle
飞桨 PaddlePaddle

Baidu's open-source deep learning platform

Model TrainingAI Open Source

More alternatives (29)

llama.cpp · Categories