Search
Sort Score
Result 10 results
Languages All
Labels All
Results 1 - 10 of 299 for

gpu

(0.12 sec)

  1. Installing GPU-accelearated package|Documentation

    Adding Gpu-accelerated package of Aspose.OCR for .NET to your project....Installing GPU-accelearated package Contents [ Hide ] GPU-accelerated...engine requires a CUDA capable GPU and NVIDIA CUDA Toolkit . To...

    docs.aspose.com/ocr/net/installation/gpu/
    more..

  2. GPU not detected|Documentation

    Aspose.LLM for .NET runs on CPU when you expected Gpu — diagnose driver, acceleration selection, binary mismatch, GpuLayers setting....GPU not detected Contents [ Hide ] You wanted the SDK to use...use the GPU, but inference is slow and nvidia-smi (or equivalent)...

    docs.aspose.com/llm/net/troubleshooting/gpu-not...
    more..

  3. GPU deployment with CUDA|Documentation

    Deploy Aspose.LLM for .NET on NVIDIA Gpus — select CUDA, offload all layers, configure multi-Gpu split, and size VRAM for model + KV cache....GPU deployment with CUDA Contents [ Hide ] CUDA is the fastest...production GPU deployment — single GPU, multi-GPU, and VRAM sizing...

    docs.aspose.com/llm/net/use-cases/gpu-deploymen...
    more..

  4. Installing GPU-accelearated package|Documentation

    Adding Gpu-accelerated package of Aspose.OCR for C++ to your project....Installing GPU-accelearated package Contents [ Hide ] GPU-accelerated...engine requires a [CUDA capable GPU] and NVIDIA CUDA Toolkit . To...

    docs.aspose.com/ocr/cpp/installation/gpu/
    more..

  5. Installing GPU-accelearated package|Documentation

    Adding Gpu-accelerated package of Aspose.OCR for Java to your project....Installing GPU-accelearated package Contents [ Hide ] GPU-accelerated...engine requires a CUDA capable GPU and NVIDIA CUDA Toolkit . Aspose...

    docs.aspose.com/ocr/java/installation/gpu/
    more..

  6. Aspose OCR GPU only works with CUDA toolkit 11....

    My setup: Windows server 2019 and Visual Studio 2019 Aspose.OCR-Gpu v25.10.0 w/ lowest Dependency behavior OnnxRuntime.Gpu v 1.16.3 CUDA toolkit v 12.0.0 CuDNN v 8.8.0 Nvidia RTX 2000E driver v 552.74 I can only ge…...Aspose OCR GPU only works with CUDA toolkit 11.8 on Windows server...Visual Studio 2019 Aspose.OCR-GPU v25.10.0 w/ lowest Dependency...

    forum.aspose.com/t/aspose-ocr-gpu-only-works-wi...
    more..

  7. GpuLayers|Documentation

    Number of model layers to offload to Gpu in Aspose.LLM for .NET — 0 for CPU-only, 999 for full offload, partial for memory-tight Gpus....many transformer layers run on GPU. Each offloaded layer lives in...system RAM. The primary knob for GPU acceleration. Quick reference...

    docs.aspose.com/llm/net/developer-reference/par...
    more..

  8. SplitMode|Documentation

    Multi-Gpu model distribution in Aspose.LLM for .NET — None for single Gpu, Layer for layer-wise split, Row for tensor parallelism....multiple GPUs. Essential only on multi-GPU hosts; on single-GPU systems...LLAMA_SPLIT_MODE_ROW Category GPU distribution Field on ModelInferenceParame...

    docs.aspose.com/llm/net/developer-reference/par...
    more..

  9. TensorSplit|Documentation

    Proportion of the model placed on each Gpu in Aspose.LLM for .NET — balances load across unequal-VRAM Gpus....an array of floats, one per GPU, that controls the proportion...model placed on each GPU during multi-GPU split. Values are normalized...

    docs.aspose.com/llm/net/developer-reference/par...
    more..

  10. CUDA|Documentation

    Run Aspose.LLM for .NET on NVIDIA Gpus with CUDA acceleration — driver requirements, compute capability, single and multi-Gpu setup....on NVIDIA GPUs. It supports single-GPU and multi-GPU setups, aggressive...cpp feature set. Requirements GPU : NVIDIA with compute capability...

    docs.aspose.com/llm/net/developer-reference/acc...
    more..