Resources / Top Repos

ggml-org/llama.cpp

A C/C++ engine for running large language models efficiently on ordinary hardware.

llama.cpp is an open-source C/C++ project for running large language models on CPUs and GPUs. It uses the GGUF model file format and supports quantisation, which shrinks models so they fit into less memory.

Good for

  • Running open-weight models on a laptop, desktop or modest server without a large GPU
  • Serving a model to other apps through its built-in server, which offers an OpenAI-compatible API
  • Developers who want fine control over settings such as context length and GPU offloading
  • Testing different quantised versions of a model to balance speed, memory and quality

Good to know

It is free under the MIT licence. It is more hands-on than Ollama: you pick the model files and settings yourself, and build or download the right binaries for your hardware. Heavier quantisation saves memory but can lower answer quality.

Works well with: open-webui/open-webui. Alternatives: ollama/ollama.

More like this

Open source

laravel/laravel

The application skeleton that every new Laravel project starts from.

#laravel #php #starter

Open source

n8n-io/n8n

The source code for n8n, the workflow automation tool you can self-host.

#automation #typescript #self-hosted

Open source

filamentphp/filament

Build admin panels, forms and data tables for Laravel apps quickly, in PHP.

#laravel #admin #livewire

Trending Open source

ollama/ollama

Download and run open-weight AI language models on your own computer or server.

#ai #local-llm #models

You're offline. Some things won't load until you reconnect.
Chat on WhatsApp

SparkWorld

+254 110 757 810

Chat with us on WhatsApp

Before we open WhatsApp, leave your name and number.

Why we ask

  • On a computer, WhatsApp only opens if WhatsApp Web is linked to your phone, and you may not be logged in.
  • So we don't lose you: if the chat doesn't start, we'll message you first.
  • We only use your details to reply to you.
Skip and open WhatsApp now