Search
Sort Score
Result 10 results
Languages All
Labels All
Results 71 - 80 of 93 for

aspose.llm

(0.07 sec)

  1. Chat parameters|Documentation

    Configure session-level conversation settings in Aspose.llm for .NET — system prompt, prior history, max tokens per response, and KV cache cleanup strategy....Class reference namespace Aspose.LLM.Abstractions.Models ; public...; Or inject turns: using Aspose.LLM.Abstractions.Models ; preset...

    docs.aspose.com/llm/net/developer-reference/par...
    more..

  2. Creating a preset from scratch|Documentation

    Extend PresetCoreBase to bring your own GGUF model into Aspose.llm for .NET — text or vision, with full control over every parameter bag.... using Aspose.LLM.Abstractions.Parameters.Presets...across environments. using Aspose.LLM.Abstractions.Parameters.Presets...

    docs.aspose.com/llm/net/developer-reference/pre...
    more..

  3. Cache management|Documentation

    Manage the KV cache in long chat sessions with Aspose.llm for .NET — automatic trimming, manual cleanup, and five strategies for deciding what to keep....CacheCleanupStrategy is an enum in Aspose.LLM.Abstractions.Models . Five...before creating the API: using Aspose.LLM.Abstractions.Models ; var...

    docs.aspose.com/llm/net/developer-reference/cac...
    more..

  4. Reduce first-token latency|Documentation

    Cut the time to first response in Aspose.llm for .NET — warm up the engine, shorten system prompts, size batches correctly, and avoid cold starts....startup: var license = new Aspose . LLM . License (); license .... SetLicense ( "Aspose.LLM.lic" ); var preset = new Qwen25Preset...

    docs.aspose.com/llm/net/how-to/reduce-first-tok...
    more..

  5. Chat history structure|Documentation

    ChatMessage type reference in Aspose.llm for .NET — roles, media attachments, and KV cache tracking fields used to locate and evict messages from the native KV region....ChatMessage reference namespace Aspose.LLM.Abstractions.Models ; public...toward ContextSize . using Aspose.LLM.Abstractions.Models ; preset...

    docs.aspose.com/llm/net/developer-reference/cha...
    more..

  6. Model inference parameters|Documentation

    Configure how a model loads into memory in Aspose.llm for .NET — GPU layer offload, tensor split across GPUs, memory mapping, memory locking, tensor validation, and metadata overrides....Class reference namespace Aspose.LLM.Abstractions.Parameters ;...parallelism where supported. using Aspose.LLM.Abstractions.Parameters ;...

    docs.aspose.com/llm/net/developer-reference/par...
    more..

  7. Vulkan|Documentation

    Run Aspose.llm for .NET with Vulkan acceleration — cross-platform, cross-vendor GPU backend that works on NVIDIA, AMD, and Intel hardware without vendor-specific runtimes.... Select Vulkan using Aspose.LLM.Abstractions.Acceleration...

    docs.aspose.com/llm/net/developer-reference/acc...
    more..

  8. System prompt recipes|Documentation

    Effective system prompts for Aspose.llm for .NET chat sessions — concise assistant, structured output, role-play, tool-use stand-ins, and format enforcement.... using Aspose.LLM.Abstractions.Models ; preset...

    docs.aspose.com/llm/net/use-cases/system-prompt...
    more..

  9. Bring your own GGUF|Documentation

    Run a custom GGUF model in Aspose.llm for .NET — pick the file, write a preset, verify compatibility, tune parameters....BaseModelSourceParam : using Aspose.LLM.Abstractions.Parameters.Presets...

    docs.aspose.com/llm/net/use-cases/bring-your-ow...
    more..

  10. Fájlformátumú API-k .NET Core, Java, Python, C+...

    Osztálykönyvtárak és REST API-k a fejlesztők számára Word, Excel, PowerPoint, Visio, PDF, CAD és számos más kategória fájlok manipulálására és feldolgozására webes, asztali vagy mobilalkalmazásokban. Fejlesztés és üzembe helyezés Windows, Linux, MacOS és Android platformokon....Medical Aspose.LLM Go Top...

    products.aspose.com/hu/
    more..