Search
Sort Score
Result 10 results
Languages All
Labels All
Results 11 - 20 of 299 for

gpu

(0.91 sec)

  1. Acceleration|Documentation

    Hardware acceleration backends supported by Aspose.LLM for .NET — CUDA, HIP (ROCm), Metal, Vulkan, and CPU variants. How auto-detection works and how to force a specific backend....per-acceleration variants — one for each GPU backend, plus CPU variants at...Supported backends Backend Platforms GPU vendor Typical priority CUDA...

    docs.aspose.com/llm/net/developer-reference/acc...
    more..

  2. HIP / ROCm|Documentation

    Run Aspose.LLM for .NET on AMD Gpus with HIP (ROCm) acceleration — supported Gpus, driver requirements, and tuning notes....ROCm stack) is the AMD-specific GPU backend for Aspose.LLM for .NET...at AMD Instinct data-center GPUs and recent Radeon consumer cards...

    docs.aspose.com/llm/net/developer-reference/acc...
    more..

  3. Supported acceleration|Documentation

    Hardware acceleration backends supported by Aspose.LLM for .NET — CUDA, HIP, Metal, Vulkan, and CPU — with a platform × backend matrix....(drivers, GpuLayers , multi-GPU split), see the detail pages...Typical use CUDA ✅ ✅ ❌ NVIDIA GPUs. Highest throughput on modern...

    docs.aspose.com/llm/net/product-overview/suppor...
    more..

  4. MainGpu|Documentation

    Gpu device index in Aspose.LLM for .NET — selects which Gpu holds the model when SplitMode is None....[ Hide ] MainGpu selects the GPU device index used when SplitMode...SplitMode is None . On multi-GPU hosts, this picks which device holds...

    docs.aspose.com/llm/net/developer-reference/par...
    more..

  5. Model inference parameters|Documentation

    Configure how a model loads into memory in Aspose.LLM for .NET — Gpu layer offload, tensor split across Gpus, memory mapping, memory locking, tensor validation, and metadata overrides....offload to GPU, how to split across multiple GPUs, whether to...of model layers to offload to GPU. 0 = CPU only, 999 = full offload...

    docs.aspose.com/llm/net/developer-reference/par...
    more..

  6. Aspose OCR slow on virtual machine - Free Suppo...

    Hello, My team noticed that the Aspose OCR engine is much slower on our virtual machine than on my desktop computer when using the Aspose OCR .NET library to extract text content from files. This raises a couple questio…...computer with a GPU compared to one without a GPU? Note that we...using Aspose.OCR (not Aspose.OCR-GPU). The specifications for both...

    forum.aspose.com/t/aspose-ocr-slow-on-virtual-m...
    more..

  7. OpOffload|Documentation

    Offload host tensor operations to device in Aspose.LLM for .NET — supplementary to GpuLayers; leave at default unless instructed....host-side tensor operations to the GPU device. This is supplementary...otherwise run on CPU even with GPU offload active. Quick reference...

    docs.aspose.com/llm/net/developer-reference/par...
    more..

  8. Vulkan|Documentation

    Run Aspose.LLM for .NET with Vulkan acceleration — cross-platform, cross-vendor Gpu backend that works on NVIDIA, AMD, and Intel hardware without vendor-specific runtimes....Hide ] Vulkan is a cross-vendor GPU backend that works on most modern...modern discrete and integrated GPUs. It does not need CUDA or ROCm...

    docs.aspose.com/llm/net/developer-reference/acc...
    more..

  9. Installation|Documentation

    Adding Aspose.OCR for Java package to your project....false To use GPU-accelerated version, make sure your GPU supports...</dependency> </dependencies> GPU-accelerated version: <dependencies>...

    docs.aspose.com/ocr/java/installation/
    more..

  10. OffloadKqv|Documentation

    Offload the KQV (attention) computation and KV cache to Gpu in Aspose.LLM for .NET — true by default on Gpu builds....cache itself live on GPU memory. On GPU-enabled builds, the default...typically true on GPU builds) Category KV cache / GPU Field on ContextParameters...

    docs.aspose.com/llm/net/developer-reference/par...
    more..