ibm-granite/granite-switch-4.1-30b开源了新模型

IBM ibm-granite/granite-switch-4.1-30b ibm-granite/granite-switch-4.1-30b https://huggingface.co/ibm-granite/granite-switch-4.1-30b

ibm-granite/granite-switch-4.1-30b · Hugging Face Hugging Face (https://huggingface.co/) Models (https://huggingface.co/models) Datasets (https://huggingface.co/datasets) Spaces (https://huggingface.co/spaces) Buckets new (https://huggingface.co/storage) Docs (https://huggingface.co/docs) Enterprise (https://huggingface.co/enterprise) Pricing (https://huggingface.co/pricing) Website Tasks (https://huggingface.co/tasks) HuggingChat (https://huggingface.co/chat) Collections (https://huggingface.co/collections) Languages (https://huggingface.co/languages) Organizations (https://huggingface.co/organizations) Community Blog (https://huggingface.co/blog) Posts (https://huggingface.co/posts) Daily Papers (https://huggingface.co/papers) Hardware (https://huggingface.co/hardware) Learn (https://huggingface.co/learn) Discord (https://huggingface.co/join/discord) Forum (https://discuss.huggingface.co/) GitHub (https://github.com/huggingface) Solutions Team & Enterprise (https://huggingface.co/enterprise) Hugging Face PRO (https://huggingface.co/pro) Enterprise Support (https://huggingface.co/support) Inference Providers (https://huggingface.co/inference/models) Inference Endpoints (https://huggingface.co/inference-endpoints) Storage Buckets (https://huggingface.co/storage) Log In (https://huggingface.co/login) Sign Up (https://huggingface.co/join) (https://huggingface.co/ibm-granite) ibm-granite (https://huggingface.co/ibm-granite) / granite-switch-4.1-30b (https://huggingface.co/ibm-granite/granite-switch-4.1-30b) Like 20 Follow IBM Granite 5.65k Text Generation (https://huggingface.co/models?pipeline_tag=text-generation) Transformers (https://huggingface.co/models?library=transformers) Safetensors (https://huggingface.co/models?library=safetensors) granite_switch (https://huggingface.co/models?other=granite_switch) language (https://huggingface.co/models?other=language) granite-switch (https://huggingface.co/models?other=granite-switch) granite-4.1 (https://huggingface.co/models?other=granite-4.1) conversational (https://huggingface.co/models?other=conversational) License: apache-2.0 Model card (https://huggingface.co/ibm-granite/granite-switch-4.1-30b) Files Files and versions xet (https://huggingface.co/ibm-granite/granite-switch-4.1-30b/tree/main) Community (https://huggingface.co/ibm-granite/granite-switch-4.1-30b/discussions) Deploy Copy to bucket new Use this model Instructions to use ibm-granite/granite-switch-4.1-30b with libraries, inference providers, notebooks, and local apps. Follow these links to get started. Libraries Transformers (https://huggingface.co/ibm-granite/granite-switch-4.1-30b?library=transformers) How to use ibm-granite/granite-switch-4.1-30b with Transformers: # Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="ibm-granite/granite-switch-4.1-30b") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages) # pip install -U transformers accelerate # Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("ibm-granite/granite-switch-4.1-30b", device_map="auto") Notebooks Google Colab (https://huggingface.co/ibm-granite/granite-switch-4.1-30b/colab) Kaggle (https://huggingface.co/ibm-granite/granite-switch-4.1-30b/kaggle) Local Apps Settings (https://huggingface.co/settings/local-apps) vLLM (https://huggingface.co/ibm-granite/granite-switch-4.1-30b?local-app=vllm) How to use ibm-granite/granite-switch-4.1-30b with vLLM: Install from pip and serve model # Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "ibm-granite/granite-switch-4.1-30b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "ibm-granite/granite-switch-4.1-30b", "messages": [ { "role": "user", "content"