inclusionAI/Ling-3.0-tiny-fp8开源了新模型

inclusionAI/Ling-3.0-tiny-fp8 · Hugging Face Hugging Face (https://huggingface.co/) Models (https://huggingface.co/models) Datasets (https://huggingface.co/datasets) Spaces (https://huggingface.co/spaces) Buckets new (https://huggingface.co/storage) Docs (https://huggingface.co/docs) Enterprise (https://huggingface.co/enterprise) Pricing (https://huggingface.co/pricing) Website Tasks (https://huggingface.co/tasks) HuggingChat (https://huggingface.co/chat) Collections (https://huggingface.co/collections) Languages (https://huggingface.co/languages) Organizations (https://huggingface.co/organizations) Community Blog (https://huggingface.co/blog) Posts (https://huggingface.co/posts) Daily Papers (https://huggingface.co/papers) Hardware (https://huggingface.co/hardware) Learn (https://huggingface.co/learn) Discord (https://huggingface.co/join/discord) Forum (https://discuss.huggingface.co/) GitHub (https://github.com/huggingface) Solutions Team & Enterprise (https://huggingface.co/enterprise) Hugging Face PRO (https://huggingface.co/pro) Enterprise Support (https://huggingface.co/support) Inference Providers (https://huggingface.co/inference/models) Inference Endpoints (https://huggingface.co/inference-endpoints) Storage Buckets (https://huggingface.co/storage) Log In (https://huggingface.co/login) Sign Up (https://huggingface.co/join) (https://huggingface.co/inclusionAI) inclusionAI (https://huggingface.co/inclusionAI) / Ling-3.0-tiny-fp8 (https://huggingface.co/inclusionAI/Ling-3.0-tiny-fp8) like 25 Follow inclusionAI 2.66k Safetensors (https://huggingface.co/models?library=safetensors) bailing_hybrid (https://huggingface.co/models?other=bailing_hybrid) custom_code (https://huggingface.co/models?other=custom_code) fp8 (https://huggingface.co/models?other=fp8) License: mit Model card (https://huggingface.co/inclusionAI/Ling-3.0-tiny-fp8) Files Files and versions xet (https://huggingface.co/inclusionAI/Ling-3.0-tiny-fp8/tree/main) Community (https://huggingface.co/inclusionAI/Ling-3.0-tiny-fp8/discussions) Copy to bucket new Introduction (https://huggingface.co/inclusionAI/Ling-3.0-tiny-fp8#introduction) Model Overview (https://huggingface.co/inclusionAI/Ling-3.0-tiny-fp8#model-overview) Evaluation (https://huggingface.co/inclusionAI/Ling-3.0-tiny-fp8#evaluation) Quickstart (https://huggingface.co/inclusionAI/Ling-3.0-tiny-fp8#quickstart) SGLang (https://huggingface.co/inclusionAI/Ling-3.0-tiny-fp8#sglang) Install SGLang (https://huggingface.co/inclusionAI/Ling-3.0-tiny-fp8#install-sglang) Run Inference (https://huggingface.co/inclusionAI/Ling-3.0-tiny-fp8#run-inference) vLLM (https://huggingface.co/inclusionAI/Ling-3.0-tiny-fp8#vllm) Install vLLM with Ling-3.0 Support (https://huggingface.co/inclusionAI/Ling-3.0-tiny-fp8#install-vllm-with-ling-30-support) Run Inference (https://huggingface.co/inclusionAI/Ling-3.0-tiny-fp8#run-inference-1) Ollama (https://huggingface.co/inclusionAI/Ling-3.0-tiny-fp8#ollama) Preparation and Build (https://huggingface.co/inclusionAI/Ling-3.0-tiny-fp8#preparation-and-build) Import Model (https://huggingface.co/inclusionAI/Ling-3.0-tiny-fp8#import-model) Start Service (https://huggingface.co/inclusionAI/Ling-3.0-tiny-fp8#start-service) Call API (https://huggingface.co/inclusionAI/Ling-3.0-tiny-fp8#call-api) 🤗 Hugging Face (https://huggingface.co/inclusionAI)    |   🤖 ModelScope (https://modelscope.cn/organization/inclusionAI)    |   🐙 OpenRouter (https://openrouter.ai/inclusionai/ling-3.0-tiny:free) (https://huggingface.co/inclusionAI/Ling-3.0-tiny-fp8#introduction) Introduction We are introducing Ling-3.0-tiny, a lightweight hybrid reasoning MoE model with 7.9B total parameters and only 1.3B activated parameters per token. It is designed to deliver strong reasoning and agentic capabilities at low inference cost, making advanced model capabilities more accessible for local and resource-constrained deployment. BF16, FP8, and INT4 weights are provid

InclusionAI inclusionAI/Ling-3.0-tiny-fp8 inclusionAI/Ling-3.0-tiny-fp8 https://huggingface.co/inclusionAI/Ling-3.0-tiny-fp8