llama-cpp

llama-cpp 0.6.0 · pkgs/by-name/ll/llama-cpp/package.nix

Health

Risk

risk 9 low

+8 0.6.0 is behind upstream 0.7.0
+1 no versionCheckHook

Version

0.6.0 upstream 0.7.0

Channels

master 0.6.0 · nixos-unstable 0.6.0 · nixos-26.05 9190 no channel is behind master

Hydra

succeeded 2d ago

Advisories

none open

Packaging

no versionCheckHook

Packagewhat each field means

Description

Inference of Meta's LLaMA model (and others) in pure C/C++

Homepage

https://github.com/ggml-org/llama.cpp

License

MIT

Platforms

45 platforms: Linux, Darwin

Main program

llama

Source provenance

not set: built from source

Outputs

out dev

Status

not broken, not insecure, free

Position

pkgs/by-name/ll/llama-cpp/package.nix:248

Maintainers

booxter, philiptaron, xddxdd, yuannan, ConnorBaker, GaetanLepage, SomeoneSerge, YorikSar, samuela, ethancedwards8

Teams

cuda-maintainers (connorbaker, gaetanlepage, someoneserge, yoriksar, samuela, ethancedwards8)

Version bumps 0all open bumps

None open. Upstream has 0.7.0: how to update a package.

Pull requests 2

nixos/llama-cpp: add multi-instance support

#488117 by randomizedcoder · opened 8mo ago · checks fail

[staging] autoAddDriverRunpathHook: init draft

#297106 by jonringer · opened 2y ago

Closed or merged in the synced window 23

whisper-cpp: 1.9.2 -> 1.9.5

#571274 by jontxux · merged 9d ago

llama-cpp: enable tests

#571132 by booxter · merged 9d ago

llama-cpp-rocm: 0.5.0 -> 0.6.0

#570664 by r-ryantm · closed 11d ago

llama-cpp-cuda: 0.5.0 -> 0.6.0

#570662 by r-ryantm · closed 11d ago

llama-cpp-vulkan: 0.5.0 -> 0.6.0

#570658 by r-ryantm · closed 11d ago

llama-cpp: 0.5.0 -> 0.6.0

#570603 by bachp · merged 10d ago

llama-cpp: 0.4.1 -> 0.5.0

#566353 by M-Schwab · merged 3w ago

python3Packages.unidiff: 1.0.0 -> 1.0.1

#564045 by pbsds · closed 4w ago

llama-cpp: run update script only for the main package

#563932 by prusnak · merged 4w ago

llama-cpp-cuda: 0.4.0 -> 0.4.1

#563833 by r-ryantm · closed 4w ago

llama-cpp-rocm: 0.4.0 -> 0.4.1

#563831 by r-ryantm · closed 4w ago

llama-cpp-vulkan: 0.4.0 -> 0.4.1

#563826 by r-ryantm · merged 4w ago

llama-cpp: fix cross compilation

#561060 by danielfullmer · merged 5w ago

llama-cpp: 0.3.0 -> 0.4.0

#560331 by M-Schwab · merged 5w ago

llama-cpp-cuda: 0.3.0 -> 0.4.0

#560291 by r-ryantm · closed 5w ago

llama-cpp-vulkan: 0.3.0 -> 0.4.0

#560287 by r-ryantm · closed 5w ago

llama-cpp-rocm: 0.3.0 -> 0.4.0

#560286 by r-ryantm · closed 5w ago

llama-cpp: simplify derivation and update script, 0.2.0 -> 0.3.0

#558301 by mirkolenz · merged 6w ago

llama-cpp: enable __structuredAttrs and strictDeps

#555851 by GaetanLepage · merged 7w ago

llama-cpp: 10408 -> 0.2.0

#555817 by booxter · merged 7w ago

llama-cpp: 10408 -> 10586

#555499 by r-ryantm · closed 7w ago

llama-cpp: remove obsolete rpcServer workaround

#553057 by m0gg · merged 8w ago

llama-cpp: update to b9503 and use nodejs_latest

#527923 by mirkolenz · merged 4mo ago

Issues 5

llama-cpp: CPU backend is built with SSE2 only (GGML_NATIVE=false leaves the ISA flags off)

#573795 by sehHeiden · opened 3d ago · 0 comments

llama-cpp, whisper-cpp: bundled GGML libraries collide in buildEnv

#554440 by jerome-benoit · opened 8w ago · 3 comments

llama-cpp: upstream and nixpkgs repo inconsistencies 6.topic: flakes

#518404 by yuannan · opened 5mo ago · 8 comments

llama-cpp: python3 (and deps) missing for scripts 2.status: stale

#379106 by matteo-pacini · opened 20mo ago · 0 comments

Build failure: llama-cpp (with opencl support) 2.status: stale

#286114 by jalil-salame · opened 2y ago · 2 comments

Closed or merged in the synced window 1

whisper-cpp: ROCm/HIP GPU never used at runtime

#548188 by ayamnova · closed 5w ago · 3 comments