Search
Sort Score
Result 10 results
Languages All
Labels All
Results 71 - 80 of 113 for

aspose.llm

(0.1 sec)

  1. Custom prompt formatter|Documentation

    Replace IPromptFormatter in Aspose.llm for .NET to support custom chat templates or post-process model output....Interface reference namespace Aspose.LLM.Abstractions.Interfaces ;...using Aspose.LLM.Abstractions.Interfaces ; using Aspose.LLM.Abstractions...

    docs.aspose.com/llm/net/developer-reference/ext...
    more..

  2. Custom file provider|Documentation

    Replace IModelFileProvider in Aspose.llm for .NET to source model files from custom locations — S3, internal registries, encrypted storage, or air-gapped networks....Interface reference namespace Aspose.LLM.Abstractions.Interfaces ;...using Aspose.LLM.Abstractions.Interfaces ; using Aspose.LLM.Abstractions...

    docs.aspose.com/llm/net/developer-reference/ext...
    more..

  3. Attaching images|Documentation

    Pass images to Aspose.llm for .NET chat methods — MediaAttachment class, supported formats (JPEG, PNG, BMP, GIF, WebP), 50 MB limit, magic-byte detection, and multiple images per message.... namespace Aspose.LLM.Abstractions.Models ; public...idiomatic constructor: using Aspose.LLM.Abstractions.Models ; var...

    docs.aspose.com/llm/net/developer-reference/mul...
    more..

  4. Chat parameters|Documentation

    Configure session-level conversation settings in Aspose.llm for .NET — system prompt, prior history, max tokens per response, and KV cache cleanup strategy....Class reference namespace Aspose.LLM.Abstractions.Models ; public...; Or inject turns: using Aspose.LLM.Abstractions.Models ; preset...

    docs.aspose.com/llm/net/developer-reference/par...
    more..

  5. Cache management|Documentation

    Manage the KV cache in long chat sessions with Aspose.llm for .NET — automatic trimming, manual cleanup, and five strategies for deciding what to keep....CacheCleanupStrategy is an enum in Aspose.LLM.Abstractions.Models . Five...before creating the API: using Aspose.LLM.Abstractions.Models ; var...

    docs.aspose.com/llm/net/developer-reference/cac...
    more..

  6. Creating a preset from scratch|Documentation

    Extend PresetCoreBase to bring your own GGUF model into Aspose.llm for .NET — text or vision, with full control over every parameter bag.... using Aspose.LLM.Abstractions.Parameters.Presets...across environments. using Aspose.LLM.Abstractions.Parameters.Presets...

    docs.aspose.com/llm/net/developer-reference/pre...
    more..

  7. Chat history structure|Documentation

    ChatMessage type reference in Aspose.llm for .NET — roles, media attachments, and KV cache tracking fields used to locate and evict messages from the native KV region....ChatMessage reference namespace Aspose.LLM.Abstractions.Models ; public...toward ContextSize . using Aspose.LLM.Abstractions.Models ; preset...

    docs.aspose.com/llm/net/developer-reference/cha...
    more..

  8. Reduce first-token latency|Documentation

    Cut the time to first response in Aspose.llm for .NET — warm up the engine, shorten system prompts, size batches correctly, and avoid cold starts....startup: var license = new Aspose . LLM . License (); license .... SetLicense ( "Aspose.LLM.lic" ); var preset = new Qwen25Preset...

    docs.aspose.com/llm/net/how-to/reduce-first-tok...
    more..

  9. Embeddings|Documentation

    Enable embedding extraction in Aspose.llm for .NET — switches the model into embedding-output mode alongside or instead of logits.... Example using Aspose.LLM.Abstractions.Models ; var...

    docs.aspose.com/llm/net/developer-reference/par...
    more..

  10. AttentionType|Documentation

    Causal vs non-causal attention in Aspose.llm for .NET — standard chat uses Causal; embedding workflows may use NonCausal....extraction NonCausal Example using Aspose.LLM.Abstractions.Models ; var...

    docs.aspose.com/llm/net/developer-reference/par...
    more..