GitHub
187.8K
Download
Models
Docs
Pricing
Sign in
Download
Models
Docs
Pricing
Sign in
inkling-2-mini
:latest
38
Downloads
Updated
18 hours ago
Thinking Machines' small open-weights model that can run on a Mac: 26B parameters, 5.4B active, with looped layers for more computation per token.
Thinking Machines' small open-weights model that can run on a Mac: 26B parameters, 5.4B active, with looped layers for more computation per token.
Cancel
vision
tools
thinking
inkling-2-mini:latest
...
/
json
16d87b9bffa9 ยท 509B
{"hidden_size": 2304, "num_hidden_layers": 3, "num_attention_heads": 24, "num_key_value_heads": 8, "head_dim": 128, "intermediate_size": 9216, "max_position_embeddings": 1048576, "torch_dtype": "bfloat16", "q_bias": false, "o_bias": false, "rms_norm_eps": 1e-06, "rope_theta": 1000000.0, "local_layer_ids": [0, 2], "sliding_window_size": 1024, "block_size": 8, "markov_rank": 256, "markov_head_type": "rnn_hidden", "target_layer_ids": [5, 23, 41, 48], "architectures": ["Inkling2ForConditionalGenerationMTP"]}