inclusionAI/Ling-3.0-tiny-int4开源了新模型

inclusionAI/Ling-3.0-tiny-int4 · Hugging Face Hugging Face (https://huggingface.co/) Models (https://huggingface.co/models) Datasets (https://huggingface.co/datasets) Spaces (https://huggingface.co/spaces) Buckets new (https://huggingface.co/storage) Docs (https://huggingface.co/docs) Enterprise (https://huggingface.co/enterprise) Pricing (https://huggingface.co/pricing) Website Tasks (https://huggingface.co/tasks) HuggingChat (https://huggingface.co/chat) Collections (https://huggingface.co/collections) Languages (https://huggingface.co/languages) Organizations (https://huggingface.co/organizations) Community Blog (https://huggingface.co/blog) Posts (https://huggingface.co/posts) Daily Papers (https://huggingface.co/papers) Hardware (https://huggingface.co/hardware) Learn (https://huggingface.co/learn) Discord (https://huggingface.co/join/discord) Forum (https://discuss.huggingface.co/) GitHub (https://github.com/huggingface) Solutions Team & Enterprise (https://huggingface.co/enterprise) Hugging Face PRO (https://huggingface.co/pro) Enterprise Support (https://huggingface.co/support) Inference Providers (https://huggingface.co/inference/models) Inference Endpoints (https://huggingface.co/inference-endpoints) Storage Buckets (https://huggingface.co/storage) Log In (https://huggingface.co/login) Sign Up (https://huggingface.co/join) (https://huggingface.co/inclusionAI) inclusionAI (https://huggingface.co/inclusionAI) / Ling-3.0-tiny-int4 (https://huggingface.co/inclusionAI/Ling-3.0-tiny-int4) like 24 Follow inclusionAI 2.66k Safetensors (https://huggingface.co/models?library=safetensors) bailing_hybrid (https://huggingface.co/models?other=bailing_hybrid) custom_code (https://huggingface.co/models?other=custom_code) compressed-tensors (https://huggingface.co/models?other=compressed-tensors) License: mit Model card (https://huggingface.co/inclusionAI/Ling-3.0-tiny-int4) Files Files and versions xet (https://huggingface.co/inclusionAI/Ling-3.0-tiny-int4/tree/main) Community 1 (https://huggingface.co/inclusionAI/Ling-3.0-tiny-int4/discussions) Copy to bucket new Introduction (https://huggingface.co/inclusionAI/Ling-3.0-tiny-int4#introduction) Model Overview (https://huggingface.co/inclusionAI/Ling-3.0-tiny-int4#model-overview) Evaluation (https://huggingface.co/inclusionAI/Ling-3.0-tiny-int4#evaluation) Quickstart (https://huggingface.co/inclusionAI/Ling-3.0-tiny-int4#quickstart) SGLang (https://huggingface.co/inclusionAI/Ling-3.0-tiny-int4#sglang) Install SGLang (https://huggingface.co/inclusionAI/Ling-3.0-tiny-int4#install-sglang) Run Inference (https://huggingface.co/inclusionAI/Ling-3.0-tiny-int4#run-inference) 🤗 Hugging Face (https://huggingface.co/inclusionAI)    |   🤖 ModelScope (https://modelscope.cn/organization/inclusionAI)    |   🐙 OpenRouter (https://openrouter.ai/inclusionai/ling-3.0-tiny:free) (https://huggingface.co/inclusionAI/Ling-3.0-tiny-int4#introduction) Introduction We are introducing Ling-3.0-tiny, a lightweight hybrid reasoning MoE model with 7.9B total parameters and only 1.3B activated parameters per token. It is designed to deliver strong reasoning and agentic capabilities at low inference cost, making advanced model capabilities more accessible for local and resource-constrained deployment. BF16, FP8, and INT4 weights are provided for a wide range of hardware and deployment settings. Key highlights of the model are summarized below: Efficient Hybrid-Linear Architecture: Ling-3.0-tiny integrates a 3:1 alternating stacking of KDA and MLA (3 Kimi Delta Attention layers followed by 1 Multi-Head Latent Attention layer per 4-layer block) with a sparse MoE FFN comprising 128 routed experts. Each token activates only 8 routed experts and 1 shared expert, allowing the model to balance long-context modeling capability, parameter efficiency, and computational cost. Native Hybrid Reasoning and Agentic Capabilities: Ling-3.0-tiny supports both fast responses and

InclusionAI inclusionAI/Ling-3.0-tiny-int4 inclusionAI/Ling-3.0-tiny-int4 https://huggingface.co/inclusionAI/Ling-3.0-tiny-int4