LiquidAI/LFM2.5-24B-A2B-ONNX开源了新模型

Liquid AI LiquidAI/LFM2.5-24B-A2B-ONNX LiquidAI/LFM2.5-24B-A2B-ONNX https://huggingface.co/LiquidAI/LFM2.5-24B-A2B-ONNX

LiquidAI/LFM2.5-24B-A2B-ONNX · Hugging Face Hugging Face (https://huggingface.co/) Models (https://huggingface.co/models) Datasets (https://huggingface.co/datasets) Spaces (https://huggingface.co/spaces) Buckets new (https://huggingface.co/storage) Docs (https://huggingface.co/docs) Enterprise (https://huggingface.co/enterprise) Pricing (https://huggingface.co/pricing) Website Tasks (https://huggingface.co/tasks) HuggingChat (https://huggingface.co/chat) Collections (https://huggingface.co/collections) Languages (https://huggingface.co/languages) Organizations (https://huggingface.co/organizations) Community Blog (https://huggingface.co/blog) Posts (https://huggingface.co/posts) Daily Papers (https://huggingface.co/papers) Hardware (https://huggingface.co/hardware) Learn (https://huggingface.co/learn) Discord (https://huggingface.co/join/discord) Forum (https://discuss.huggingface.co/) GitHub (https://github.com/huggingface) Solutions Team & Enterprise (https://huggingface.co/enterprise) Hugging Face PRO (https://huggingface.co/pro) Enterprise Support (https://huggingface.co/support) Inference Providers (https://huggingface.co/inference/models) Inference Endpoints (https://huggingface.co/inference-endpoints) Storage Buckets (https://huggingface.co/storage) Log In (https://huggingface.co/login) Sign Up (https://huggingface.co/join) (https://huggingface.co/LiquidAI) LiquidAI (https://huggingface.co/LiquidAI) / LFM2.5-24B-A2B-ONNX (https://huggingface.co/LiquidAI/LFM2.5-24B-A2B-ONNX) Like 19 Follow Liquid AI 6.08k Text Generation (https://huggingface.co/models?pipeline_tag=text-generation) ONNX (https://huggingface.co/models?library=onnx) 10 languages lfm2_moe (https://huggingface.co/models?other=lfm2_moe) liquid (https://huggingface.co/models?other=liquid) edge (https://huggingface.co/models?other=edge) lfm2.5 (https://huggingface.co/models?other=lfm2.5) Mixture of Experts (https://huggingface.co/models?other=moe) onnxruntime (https://huggingface.co/models?other=onnxruntime) onnxruntime-genai (https://huggingface.co/models?other=onnxruntime-genai) conversational (https://huggingface.co/models?other=conversational) License: lfm1.0 Model card (https://huggingface.co/LiquidAI/LFM2.5-24B-A2B-ONNX) Files Files and versions xet (https://huggingface.co/LiquidAI/LFM2.5-24B-A2B-ONNX/tree/main) Community (https://huggingface.co/LiquidAI/LFM2.5-24B-A2B-ONNX/discussions) Copy to bucket new LFM2.5-24B-A2B-ONNX (https://huggingface.co/LiquidAI/LFM2.5-24B-A2B-ONNX#lfm25-24b-a2b-onnx) Recommended Variants (https://huggingface.co/LiquidAI/LFM2.5-24B-A2B-ONNX#recommended-variants) Model Files (https://huggingface.co/LiquidAI/LFM2.5-24B-A2B-ONNX#model-files) Python (onnxruntime-genai) (https://huggingface.co/LiquidAI/LFM2.5-24B-A2B-ONNX#python-onnxruntime-genai) License (https://huggingface.co/LiquidAI/LFM2.5-24B-A2B-ONNX#license) Try LFM (https://playground.liquid.ai/) • Docs (https://docs.liquid.ai/lfm/getting-started/welcome) • Discord (https://discord.com/invite/liquid-ai) (https://huggingface.co/LiquidAI/LFM2.5-24B-A2B-ONNX#lfm25-24b-a2b-onnx) LFM2.5-24B-A2B-ONNX LFM2.5-24B-A2B is a Mixture of Experts reasoning model with 24B total parameters and 2B active parameters per token, built for fast, private agents on-device. It is the largest model in the LFM2.5 family. Find more details in the original model card: https://huggingface.co/LiquidAI/LFM2.5-24B-A2B (https://huggingface.co/LiquidAI/LFM2.5-24B-A2B) (https://huggingface.co/LiquidAI/LFM2.5-24B-A2B-ONNX#recommended-variants) Recommended Variants Precision Size Platform Use Case Q4 ~15.3 GB CPU Recommended for most uses (default) Q4F16 ~13.7 GB CUDA Q4 experts with FP16 runtime Q8 ~27.1 GB CPU Balance of quality and size FP16 ~48.0 GB CUDA Higher quality CPU: Use Q4 or Q8. CUDA: Use Q4F16 or FP16. This model is too large for WebGPU browser inference. (https://huggingface.co/LiquidAI/LFM2.5-24B-A2B-ONNX#model-files) Model Files