Skip to main content
Ctrl+K

locodellm

  • Examples
  • Command Line Interface
  • API
  • GitHub
  • Examples
  • Command Line Interface
  • API
  • GitHub

Section Navigation

  • locodellm.session
    • locodellm.session.session_state
  • generate
    • generate_from_model
  • locodellm.bench
    • Available Benchmarks
    • locodellm.bench.run_code
    • locodellm.bench.prompt_test
    • locodellm.bench.bench_result
  • locodellm.test_models
    • locodellm.test_models.tiny_model
    • locodellm.test_models.mock_generate_model
  • API
  • generate

generate#

  • generate_from_model

Generation utilities for calling local LLMs via onnxruntime-genai.

previous

locodellm.session.session_state

next

generate_from_model
Show Source

Created using Sphinx 9.1.0.

Built with the PyData Sphinx Theme 0.21.0.