latest
792MB
NT-Java is a lightweight 1.1B state-of-the-art open models by Infosys.
1B
154 Pulls Updated 7 weeks ago
Updated 7 weeks ago
7 weeks ago
474c412a5db6 · 868MB
model
archstarcoder
·
parameters1.24B
·
quantizationQ5_0
868MB
params
{"num_ctx":4096,"stop":["<|endoftext|>"]}
52B
Readme
NT-Java is a lightweight 1.1B state-of-the-art open models by Infosys
Usage
CLI
Instruct:
ollama run infosys/nt-java
API
Example:
curl -X POST http://localhost:11434/api/generate -d '{
"model": "infosys/nt-java",
"prompt":"public class HelloWorld {\n public static void main(String[] args) {"
}'
Using NT-Java with popular tooling
LangChain
from langchain_community.llms import Ollama
llm = Ollama(model="infosys/nt-java")
llm.invoke("public class HelloWorld {\n public static void main(String[] args) {")
LlamaIndex
from llama_index.llms.ollama import Ollama
llm = Ollama(model="infosys/nt-java")
llm.complete("public class HelloWorld {\n public static void main(String[] args) {")