1,335 Downloads Updated 1 year ago
Name
9 models
nt-java:latest
792MB · 8K context window · Text · 1 year ago
nt-java:1b-q2_K
511MB · 8K context window · Text · 1 year ago
nt-java:1b-q3_K_M
663MB · 8K context window · Text · 1 year ago
nt-java:1b-q4_0
726MB · 8K context window · Text · 1 year ago
nt-java:1b-q5_0
868MB · 8K context window · Text · 1 year ago
nt-java:1b-q5_K_M
910MB · 8K context window · Text · 1 year ago
nt-java:1b-q6_K
1.0GB · 8K context window · Text · 1 year ago
nt-java:1b-q8_0
1.3GB · 8K context window · Text · 1 year ago
nt-java:1b-fp16
2.5GB · 8K context window · Text · 1 year ago
NT-Java is a lightweight 1.1B state-of-the-art open models by Infosys
CLI
Instruct:
ollama run infosys/nt-java
API
Example:
curl -X POST http://localhost:11434/api/generate -d '{
"model": "infosys/nt-java",
"prompt":"public class HelloWorld {\n public static void main(String[] args) {"
}'
LangChain
from langchain_community.llms import Ollama
llm = Ollama(model="infosys/nt-java")
llm.invoke("public class HelloWorld {\n public static void main(String[] args) {")
LlamaIndex
from llama_index.llms.ollama import Ollama
llm = Ollama(model="infosys/nt-java")
llm.complete("public class HelloWorld {\n public static void main(String[] args) {")