Jan-nano-gguf

Author: Menlo
Downloads: 8,944
Likes: 136
License: Apache 2.0
Created: Jun 11, 2025
Last Modified: Jul 1, 2025

Jan Nano

Note: Jan-Nano is a non-thinking model.

Authors: Alan Dao, Bach Vu Dinh

image/png

Overview

Jan Nano is a fine-tuned language model built on top of the Qwen3 architecture. Developed as part of the Jan ecosystem, it balances compact size and extended context length, making it ideal for efficient, high-quality text generation in local or embedded environments.

Features

  • Tool Use: Excellent function calling and tool integration
  • Research: Enhanced research and information processing capabilities
  • Small Model: VRAM efficient for local deployment

Use it with Jan (UI)

  1. Install Jan using Quickstart

Original weight: https://huggingface.co/Menlo/Jan-nano

Recommended Sampling Parameters

  • Temperature: 0.7
  • Top-p: 0.8
  • Top-k: 20
  • Min-p: 0

📄 Citation

@misc{dao2025jannanotechnicalreport,
      title={Jan-nano Technical Report}, 
      author={Alan Dao and Dinh Bach Vu},
      year={2025},
      eprint={2506.22760},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2506.22760}, 
}

Documentation

Setup, Usage & FAQ

Share this model

Found this model useful? Share it with others!