locodellm

Experimentation around local LLM using onnxruntime-genai.

Install

pip install -e .

Quick start

from locodellm.session import create_session

session = create_session("path/to/model")
session.generate("Once upon a time")
print(session.text)

Contents

• Examples
• API
  • locodellm.session
  • locodellm.test_models