Search
Sort Score
Result 10 results
Languages All
Labels All
Results 51 - 60 of 93 for

aspose.llm

(0.92 sec)

  1. Troubleshooting|Documentation

    Diagnose and fix common Aspose.llm for .NET problems — binary download failures, out-of-memory, GPU detection, model load, garbled output, license, performance....these: License applied : Aspose.LLM.License.IsLicensed returns...Forum with: SDK version ( Aspose.LLM NuGet version). Host OS and...

    docs.aspose.com/llm/net/troubleshooting/
    more..

  2. Acceleration|Documentation

    Hardware acceleration backends supported by Aspose.llm for .NET — CUDA, HIP (ROCm), Metal, Vulkan, and CPU variants. How auto-detection works and how to force a specific backend....Acceleration Contents [ Hide ] Aspose.LLM for .NET wraps llama.cpp...AccelerationType value: using Aspose.LLM.Abstractions.Acceleration...

    docs.aspose.com/llm/net/developer-reference/acc...
    more..

  3. Low memory tuning|Documentation

    Fit Aspose.llm for .NET into a tight memory budget — small model, short context, KV cache quantization, aggressive offload, and memory mapping....Quantize the KV cache using Aspose.LLM.Abstractions.Models ; preset...minimal-memory example using Aspose.LLM ; using Aspose.LLM.Abstractions.Acceleration...

    docs.aspose.com/llm/net/use-cases/low-memory-tu...
    more..

  4. Quick wins|Documentation

    Five compact recipes for common Aspose.llm for .NET tasks — first message, image input, session save/restore, CPU-only run, and CUDA GPU run....pattern: using Aspose.LLM ; using Aspose.LLM.Abstractions.Parameters...Presets ; var license = new Aspose . LLM . License (); license ....

    docs.aspose.com/llm/net/quick-wins/
    more..

  5. Presets|Documentation

    Preset base class, parameter bags, and patterns for using and customizing presets in Aspose.llm for .NET....PresetCoreBase in namespace Aspose.LLM.Abstractions.Parameters.Presets...a preset using Aspose.LLM ; using Aspose.LLM.Abstractions.Parameters...

    docs.aspose.com/llm/net/developer-reference/pre...
    more..

  6. Multimodal context parameters|Documentation

    Configure the mtmd (multimodal) context in Aspose.llm for .NET — GPU offload for the vision projector, timing diagnostics, thread count, verbosity, and media marker....Class reference namespace Aspose.LLM.Abstractions.Parameters ;...zsh helper script in the Aspose.LLM SDK repository. MediaMarker...

    docs.aspose.com/llm/net/developer-reference/par...
    more..

  7. Model source parameters|Documentation

    Configure where Aspose.llm for .NET loads a model from — local file, Aspose model repository, or Hugging Face — including the resolution order....Class reference namespace Aspose.LLM.Abstractions.Parameters ;...Windows is %LOCALAPPDATA%\Aspose.LLM\models ; on Linux and macOS...

    docs.aspose.com/llm/net/developer-reference/par...
    more..

  8. Debugging vision|Documentation

    Diagnose multimodal issues in Aspose.llm for .NET — tagged log taxonomy, common misalignments, and the parse_mm_logs.zsh helper....zsh helper The Aspose.LLM SDK repository includes a...

    docs.aspose.com/llm/net/developer-reference/mul...
    more..

  9. Long context tuning|Documentation

    Configure Aspose.llm for .NET for 128K-262K contexts — pick the right preset, enable flash attention, quantize the KV cache, and manage memory....when it is supported: using Aspose.LLM.Abstractions.Models ; preset...summarization using Aspose.LLM ; using Aspose.LLM.Abstractions.Models...

    docs.aspose.com/llm/net/use-cases/long-context-...
    more..

  10. Chat sessions|Documentation

    Create chat sessions, send messages, manage the current session, trim the KV cache, and understand concurrency constraints in Aspose.llm for .NET....sessions Contents [ Hide ] Aspose.LLM for .NET groups conversations...

    docs.aspose.com/llm/net/developer-reference/cha...
    more..