Search
Sort Score
Result 10 results
Languages All
Labels All
Results 11 - 20 of 93 for

aspose.llm

(1.02 sec)

  1. HIP / ROCm|Documentation

    Run Aspose.llm for .NET on AMD GPUs with HIP (ROCm) acceleration — supported GPUs, driver requirements, and tuning notes....AMD-specific GPU backend for Aspose.LLM for .NET. It is Linux-only...Windows ROCm in preview, but Aspose.LLM’s HIP binaries currently...

    docs.aspose.com/llm/net/developer-reference/acc...
    more..

  2. Dependency injection|Documentation

    Register Aspose.llm for .NET services in a Microsoft.Extensions.DependencyInjection container via AddLlamaServices. Alternative entry point for ASP.NET Core and Worker Service applications....injection Contents [ Hide ] Aspose.LLM for .NET provides an extension...Method signature namespace Aspose.LLM.Core.DependencyInjection...

    docs.aspose.com/llm/net/developer-reference/dep...
    more..

  3. API reference|Documentation

    Links to the full class-level API reference and a summary of the key Aspose.llm for .NET types....class-level API reference for Aspose.LLM for .NET is published separately...XML documentation comment. Aspose.LLM for .NET API Reference —...

    docs.aspose.com/llm/net/developer-reference/api...
    more..

  4. Features|Documentation

    Capabilities of Aspose.llm for .NET — local inference, chat sessions, vision input, acceleration, session persistence, and what the SDK does not do....Features Contents [ Hide ] Aspose.LLM for .NET lets you run large...License.IsLicensed . What Aspose.LLM does not do Honest limits...

    docs.aspose.com/llm/net/product-overview/features/
    more..

  5. Offline deployment|Documentation

    Deploy Aspose.llm for .NET to air-gapped, firewalled, or no-internet environments — pre-download native binaries and model files, wire up local cache paths....deployment Contents [ Hide ] Aspose.LLM for .NET downloads native...BinaryPath (default <LocalAppData>/Aspose.LLM/runtimes ). Model and mmproj...

    docs.aspose.com/llm/net/use-cases/offline-deplo...
    more..

  6. Binary manager parameters|Documentation

    Configure how Aspose.llm for .NET downloads and caches native llama.cpp binaries — release tag, cache path, system specification, and preferred acceleration backend....Class reference namespace Aspose.LLM.Abstractions.Parameters ;...set ; } // <LocalAppData>/Aspose.LLM/runtimes public SystemSpec...

    docs.aspose.com/llm/net/developer-reference/par...
    more..

  7. License class|Documentation

    API reference for the Aspose.llm.License class — SetLicense methods and IsLicensed property....License class Contents [ Hide ] Aspose.LLM.License is the class used...Class reference namespace Aspose.LLM ; public class License {...

    docs.aspose.com/llm/net/developer-reference/lic...
    more..

  8. Binary download fails|Documentation

    Diagnose why Aspose.llm for .NET fails to download native llama.cpp binaries on first Create — proxy, firewall, rate limits, disk space, SSL....local/share/Aspose.LLM/runtimes # Windows # Check...Check %LOCALAPPDATA%\Aspose.LLM\runtimes free space. 6. Handle GitHub...

    docs.aspose.com/llm/net/troubleshooting/binary-...
    more..

  9. Streaming-like responses|Documentation

    Aspose.llm for .NET does not expose token streaming. This page documents the limitation, the workarounds, and the patterns that deliver a responsive user experience without streaming....responses Contents [ Hide ] Aspose.LLM for .NET does not expose...with alternatives Feature Aspose.LLM for .NET Hosted APIs (OpenAI...

    docs.aspose.com/llm/net/use-cases/streaming-lik...
    more..

  10. CPU-only deployment|Documentation

    Run Aspose.llm for .NET without a GPU — pick a small preset, tune threads, and set realistic performance expectations....GPU, or no GPU supported by Aspose.LLM. Container or serverless...the preset: using Aspose.LLM ; using Aspose.LLM.Abstractions.Acceleration...

    docs.aspose.com/llm/net/use-cases/cpu-only-depl...
    more..