112 3 months ago

Microsoft phi4-reasoning-plus converted to gguf for use :マイクロソフトのphi4-reasoning-plusをggufに変換して使えるようにしました

3 months ago

ef3d8e57887f · 29GB

phi3
·
14.7B
·
F16
<|im_start|>system<|im_sep|>{{ .System }}<|im_end|> {{- range .Messages }} {{- if eq .Role "user" -}
You are Phi, a language model trained by Microsoft to help users. Your role as an assistant involves
{ "stop": [ "<|im_end|>" ], "temperature": 0.3, "top_p": 0.9 }

Readme

Phi-4 Reasoning Plus (Ollama Compatible)

This is a local deployment package of microsoft/Phi-4-reasoning-plus, converted to GGUF format and optimized for use with Ollama.

Model Description

Phi-4-Reasoning-Plus is a state-of-the-art small language model developed by Microsoft, designed to perform deep multi-step reasoning. This package includes: - A custom Modelfile using a system prompt that guides the model to answer using <think> and <solution> sections. - A chat template compliant with Phi’s formatting (<|im_start|>, <|im_sep|>, etc.). - Adjusted inference parameters for optimal reasoning quality.

Usage

ollama create phi4-rplus -f Modelfile
ollama run phi4-rplus

LICENCE

Copyright © Microsoft Corporation

This model is licensed under the OpenRAIL-M license.

Redistribution and use of the model and associated files, with or without modification, are permitted provided that the following conditions are met:

  1. Redistributions must retain the above copyright notice, this list of conditions and the following disclaimer.
  2. Use of the model must not be in violation of applicable laws or regulations.
  3. No use of the model may be made in any way that causes or could cause harm.

See the full license here: https://huggingface.co/microsoft/Phi-4-reasoning-plus/blob/main/LICENSE