infosys/
nt-java:1b-q5_K_M

1,335 1 year ago

NT-Java is a lightweight 1.1B state-of-the-art open models by Infosys.

1 year ago

9861b54e7768 · 910MB ·

starcoder
·
1.24B
·
Q5_K_M
{ "num_ctx": 4096, "stop": [ "<|endoftext|>" ] }

Readme

2370783.webp

NT-Java is a lightweight 1.1B state-of-the-art open models by Infosys

Usage

CLI

Instruct:

ollama run infosys/nt-java

API

Example:

curl -X POST http://localhost:11434/api/generate -d '{
  "model": "infosys/nt-java",
  "prompt":"public class HelloWorld {\n    public static void main(String[] args) {"
 }'

Using NT-Java with popular tooling

LangChain

from langchain_community.llms import Ollama
llm = Ollama(model="infosys/nt-java")
llm.invoke("public class HelloWorld {\n    public static void main(String[] args) {")

LlamaIndex

from llama_index.llms.ollama import Ollama
llm = Ollama(model="infosys/nt-java")
llm.complete("public class HelloWorld {\n    public static void main(String[] args) {")

References

HuggingFace