motif64
Log in

All capsules

2 capsules, newest first

Clear
  • m64_53ac9668fd7cChat · Qwen3 4B Q4_K_M · llama.cpp · NVIDIA · 6 GB VRAM

    A small local model for opencode: Qwen3 4B (Q4_K_M GGUF) on llama.cpp's server, an OpenAI-compatible chat endpoint with tool calls, for opencode running on your own machine. About 6 GB of VRAM, 32k context. Needs no network.

    #example#opencode#qwen#gguf@dh7
  • m64_dfd55abca230Chat · Qwen3.8-Flash-Next IQ3_S · Basalt · GeForce RTX 5090 · 30 GB VRAM

    Qwen3.8-Flash-Next on Basalt (RTX 5090), for opencode. A local OpenAI-compatible chat endpoint for Qwen3.8-Flash-Next (IQ3_S pack) on the Basalt engine, with a 384k context (YaRN x1.5), for opencode running on your own machine: opencode and its file access stay there, only the model calls come here. Streams, tool calls, images. About 300 tok/s on one RTX 5090 with 64 GB of RAM. Needs no network.

    #qwen#gguf#rtx5090@dh7