View this model on HuggingFace:

huggingface.co/DeepHat/DeepHat-V1-7B

Our latest model is live in our Web App and on Kindo.ai!

This is currently a preview release that is subject to change. Access at: deephat.ai

Our Discord Server

Join us at: https://discord.gg/8Ynkrcbk92

Technical Overview

DeepHat is a finetune of Qwen2.5-Coder-7B, and inherits the following features:

Type: Causal Language Models

Training Stage: Pretraining & Post-training

Architecture: transformers with RoPE, SwiGLU, RMSNorm, and Attention QKV bias

Number of Parameters: 7.61B

Number of Parameters (Non-Embedding): 6.53B

Number of Layers: 28

Number of Attention Heads (GQA): 28 for Q and 4 for KV

Context Length: Full 131,072 tokens

License

Apache-2.0 + DeepHat Extended Version

DeepHat Extension to Apache-2.0 Licence: Usage Restrictions

You agree not to use the Model or Derivatives of the Model:

• In any way that violates any applicable national or international law or regulation or infringes upon the lawful rights and interests of any third party;
• For military use in any way;
• For the purpose of exploiting, harming or attempting to exploit or harm minors in any way;
• To generate or disseminate verifiably false information and/or content with the purpose of harming others;
• To generate or disseminate inappropriate content subject to applicable regulatory requirements;
• To generate or disseminate personal identifiable information without due authorization or for unreasonable use;
• To defame, disparage or otherwise harass others;
• For fully automated decision making that adversely impacts an individual’s legal rights or otherwise creates or modifies a binding, enforceable obligation;
• For any use intended to or which has the effect of discriminating against or harming individuals or groups based on online or offline social behavior or known or predicted personal or personality characteristics;
• To exploit any of the vulnerabilities of a specific group of persons based on their age, social, physical or mental characteristics, in order to materially distort the behavior of a person pertaining to that group in a manner that causes or is likely to cause that person or another person physical or psychological harm;
• For any use intended to or which has the effect of discriminating against individuals or groups based on legally protected characteristics or categories.

Terms of Use

By accessing and using this Artificial Intelligence (AI) model, you, the user, acknowledge and agree that you are solely responsible for your use of the model and its outcomes. You hereby agree to indemnify, defend, and hold harmless the creators, developers, and any affiliated persons or entities of this AI model from and against any and all claims, liabilities, damages, losses, costs, expenses, fees (including reasonable attorneys’ fees and court costs) that may arise, directly or indirectly, from your use of the AI model.

This AI model is provided “as is” and “as available” without any warranty of any kind, express or implied, including but not limited to the warranties of merchantability, fitness for a particular purpose, and non-infringement. The creators make no warranty that the AI model will meet your requirements or be available on an uninterrupted, secure, or error-free basis.

Your use of the AI model is at your own risk and discretion, and you will be solely responsible for any damage to computer systems or loss of data that results from the use of the AI model.

This disclaimer constitutes part of the agreement between you and the creators of the AI model regarding your use of the model, superseding any prior agreements between you and the creators regarding your use of this AI model.