Search
Sort Score
Result 10 results
Languages All
Labels All
Results 21 - 30 of 113 for

aspose.llm

(1.33 sec)

  1. Binary download fails|Documentation

    Diagnose why Aspose.llm for .NET fails to download native llama.cpp binaries on first Create — proxy, firewall, rate limits, disk space, SSL....local/share/Aspose.LLM/runtimes # Windows # Check...Check %LOCALAPPDATA%\Aspose.LLM\runtimes free space. 6. Handle GitHub...

    docs.aspose.com/llm/net/troubleshooting/binary-...
    more..

  2. Custom preset|Documentation

    Customize a built-in Aspose.llm for .NET preset or build one from scratch — three patterns for bringing your own parameters or your own GGUF model.... using Aspose.LLM ; using Aspose.LLM.Abstractions.Parameters...Presets ; var license = new Aspose . LLM . License (); license ....

    docs.aspose.com/llm/net/use-cases/custom-preset/
    more..

  3. Batch processing of text or images - Free Suppo...

    I have a potential project for processing some data using LLM. It is very timely that AsposeLLM was announced. I spent a bit of time playing with it and ran into one issue. I’m unable to clear vram between items I’m proc…...processing of text or images Aspose.LLM Product Family NPozdniakov...

    forum.aspose.com/t/batch-processing-of-text-or-...
    more..

  4. CPU-only deployment|Documentation

    Run Aspose.llm for .NET without a GPU — pick a small preset, tune threads, and set realistic performance expectations....GPU, or no GPU supported by Aspose.LLM. Container or serverless...the preset: using Aspose.LLM ; using Aspose.LLM.Abstractions.Acceleration...

    docs.aspose.com/llm/net/use-cases/cpu-only-depl...
    more..

  5. Batch processing|Documentation

    Run many prompts through one loaded Aspose.llm model — amortize the load cost, pick session-per-prompt vs shared-session patterns.... using Aspose.LLM ; using Aspose.LLM.Abstractions.Parameters...Presets ; var license = new Aspose . LLM . License (); license ....

    docs.aspose.com/llm/net/use-cases/batch-process...
    more..

  6. Session persistence|Documentation

    Save and load chat sessions with Aspose.llm for .NET — file format, what is preserved, and parameter behavior on load....persistence Contents [ Hide ] Aspose.LLM for .NET can serialize an...workflow using Aspose.LLM ; using Aspose.LLM.Abstractions.Parameters...

    docs.aspose.com/llm/net/developer-reference/ses...
    more..

  7. Engine parameters|Documentation

    Configure engine-wide defaults in Aspose.llm for .NET — model cache path, debug logging, log file location, and default thread count....Class reference namespace Aspose.LLM.Core.DependencyInjection...// default: <LocalAppData>/Aspose.LLM/models public bool EnableDebugLogging...

    docs.aspose.com/llm/net/developer-reference/par...
    more..

  8. GPU deployment with CUDA|Documentation

    Deploy Aspose.llm for .NET on NVIDIA GPUs — select CUDA, offload all layers, configure multi-GPU split, and size VRAM for model + KV cache....is the fastest backend for Aspose.LLM for .NET on NVIDIA hardware...model on it. using Aspose.LLM ; using Aspose.LLM.Abstractions.Acceleration...

    docs.aspose.com/llm/net/use-cases/gpu-deploymen...
    more..

  9. Simple chat|Documentation

    Send messages to Aspose.llm for .NET without managing sessions yourself — the engine creates and tracks a session implicitly....Minimal example using Aspose.LLM ; using Aspose.LLM.Abstractions.Parameters...Presets ; var license = new Aspose . LLM . License (); license ....

    docs.aspose.com/llm/net/use-cases/simple-chat/
    more..

  10. GPU not detected|Documentation

    Aspose.llm for .NET runs on CPU when you expected GPU — diagnose driver, acceleration selection, binary mismatch, GpuLayers setting....nvidia-smi does not list the Aspose.LLM process. rocm-smi shows zero...GPU. Fix by forcing: using Aspose.LLM.Abstractions.Acceleration...

    docs.aspose.com/llm/net/troubleshooting/gpu-not...
    more..