64 2 months ago

Converted to MXFP4_MOE from https://huggingface.co/FreeSEED-AI/gpt-oss-120b-mandarin-thinking

tools thinking

2 months ago

3cf89c1cc188 ยท 63GB ยท

gpt-oss
ยท
117B
ยท
(!unknown_file_type 38!)
<|start|>system<|message|>You are ChatGPT, a large language model trained by OpenAI. Knowledge cutof
Apache License Version 2.0, January 2004 http://www.apache.org/licenses/ TERMS AND CONDITIONS FOR US
{ "temperature": 1 }

Readme

GPT-OSS-ZhTW-Thinking-MXFP4-MOE-GGUF

Model on HuggingFace License

A specialized language model optimized for thinking in Traditional Chinese (Taiwanese Mandarin).

This is a quantized GGUF version of the GPT-OSS-ZhTW-Thinking model.

Converted via llama.cpp b6316

๐ŸŒŸ Key Features

  • Native Taiwanese Mandarin Thinking: Default reasoning and thinking patterns optimized for Traditional Chinese
  • Enhanced Cultural Understanding: Deep comprehension of Taiwanese cultural contexts, idioms, and social nuances
  • GPT-based Architecture: Standard GPT-OSS transformer architecture fine-tuned for zh-TW applications

๐Ÿ“Š Model Specifications

  • Model Size: 120B parameters
  • Architecture: GPT-based MoE transformer
  • Training: Fine-tuned for Traditional Chinese (zh-TW)

๐Ÿš€ Usage

Serving with vllm or sglang.

๐Ÿ“ License

This model is released under the Apache 2.0 License.

๐Ÿค Contributing

We welcome contributions and feedback! Please open an issue or submit a pull request if you have suggestions for improvements.


Made with โค๏ธ by FreeSEED-AI