Try LFM • Docs • LEAP • Discord

LFM2.5-VL-3B-GGUF

LFM2.5 is a new generation of hybrid models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency.

Find more details in the original model card: https://huggingface.co/LiquidAI/LFM2.5-VL-3B

🏃 How to run LFM2.5-VL-3B

Example usage with llama.cpp:

llama-cli \
  -hf LiquidAI/LFM2.5-VL-3B-GGUF \
  --temp 0.2 \
  --top-k 50 \
  --repeat-penalty 1.0

Then you can type /image <IMAGE PATH> to add an image to the chat, then ask What is in the image? or any other question about the image.