amd/Meta-Llama-3.1-8B-Instruct_rai_1.8.0_medusa_npu_4K开源了新模型

amd/Meta-Llama-3.1-8B-Instruct_rai_1.8.0_medusa_npu_4K · Hugging Face Hugging Face (https://huggingface.co/) Models (https://huggingface.co/models) Datasets (https://huggingface.co/datasets) Spaces (https://huggingface.co/spaces) Buckets new (https://huggingface.co/storage) Docs (https://huggingface.co/docs) Enterprise (https://huggingface.co/enterprise) Pricing (https://huggingface.co/pricing) Website Tasks (https://huggingface.co/tasks) HuggingChat (https://huggingface.co/chat) Collections (https://huggingface.co/collections) Languages (https://huggingface.co/languages) Organizations (https://huggingface.co/organizations) Community Blog (https://huggingface.co/blog) Posts (https://huggingface.co/posts) Daily Papers (https://huggingface.co/papers) Hardware (https://huggingface.co/hardware) Learn (https://huggingface.co/learn) Discord (https://huggingface.co/join/discord) Forum (https://discuss.huggingface.co/) GitHub (https://github.com/huggingface) Solutions Team & Enterprise (https://huggingface.co/enterprise) Hugging Face PRO (https://huggingface.co/pro) Enterprise Support (https://huggingface.co/support) Inference Providers (https://huggingface.co/inference/models) Inference Endpoints (https://huggingface.co/inference-endpoints) Storage Buckets (https://huggingface.co/storage) Log In (https://huggingface.co/login) Sign Up (https://huggingface.co/join) (https://huggingface.co/amd) amd (https://huggingface.co/amd) / Meta-Llama-3.1-8B-Instruct_rai_1.8.0_medusa_npu_4K (https://huggingface.co/amd/Meta-Llama-3.1-8B-Instruct_rai_1.8.0_medusa_npu_4K) Like 0 Follow AMD 3.25k Text Generation (https://huggingface.co/models?pipeline_tag=text-generation) ONNX (https://huggingface.co/models?library=onnx) English (https://huggingface.co/models?language=en) amd (https://huggingface.co/models?other=amd) ryzenai (https://huggingface.co/models?other=ryzenai) medusa_npu_4K (https://huggingface.co/models?other=medusa_npu_4K) conversational (https://huggingface.co/models?other=conversational) License: llama3.1 Model card (https://huggingface.co/amd/Meta-Llama-3.1-8B-Instruct_rai_1.8.0_medusa_npu_4K) Files Files and versions xet (https://huggingface.co/amd/Meta-Llama-3.1-8B-Instruct_rai_1.8.0_medusa_npu_4K/tree/main) Community (https://huggingface.co/amd/Meta-Llama-3.1-8B-Instruct_rai_1.8.0_medusa_npu_4K/discussions) Copy to bucket new You need to agree to share your contact information to access this model This repository is publicly accessible, but you have to accept the conditions to access its files and content. Log in (https://huggingface.co/login?next=/amd/Meta-Llama-3.1-8B-Instruct_rai_1.8.0_medusa_npu_4K) or Sign Up (https://huggingface.co/join?next=/amd/Meta-Llama-3.1-8B-Instruct_rai_1.8.0_medusa_npu_4K) to review the conditions and access this model content. Meta-Llama-3.1-8B-Instruct_rai_1.8.0_medusa_npu_4K (https://huggingface.co/amd/Meta-Llama-3.1-8B-Instruct_rai_1.8.0_medusa_npu_4K#meta-llama-31-8b-instructrai_180_medusa_npu4k) (https://huggingface.co/amd/Meta-Llama-3.1-8B-Instruct_rai_1.8.0_medusa_npu_4K#meta-llama-31-8b-instruct_rai_180_medusa_npu_4k) Meta-Llama-3.1-8B-Instruct_rai_1.8.0_medusa_npu_4K Source model: Meta-Llama-3.1-8B-Instruct (https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct) (https://huggingface.co/amd/Meta-Llama-3.1-8B-Instruct_rai_1.8.0_medusa_npu_4K#introduction) Introduction This model was created using Quark Quantization, followed by OGA Model Builder, and finalized with post-processing for NPU deployment with Medusa speculative decoding (Full Fusion 4K context). (https://huggingface.co/amd/Meta-Llama-3.1-8B-Instruct_rai_1.8.0_medusa_npu_4K#quantization-strategy) Quantization Strategy AWQ / Group 128 / Asymmetric / BFP16 activations / UINT4 Weights (https://huggingface.co/amd/Meta-Llama-3.1-8B-Instruct_rai_1.8.0_medusa_npu_4K#quick-start) Quick Start For quickstart, refer to Ryzen AI documentation (https://ryzenai.docs.amd.com/en/la

AMD amd/Meta-Llama-3.1-8B-Instruct_rai_1.8.0_medusa_npu_4K amd/Meta-Llama-3.1-8B-Instruct_rai_1.8.0_medusa_npu_4K https://huggingface.co/amd/Meta-Llama-3.1-8B-Instruct_rai_1.8.0_medusa_npu_4K