Search
Sort Score
Result 10 results
Languages All
Labels All
Results 1 - 10 of 304 for

gpu

(0.99 sec)

  1. Installing GPU-accelearated package|Documentation

    Adding Gpu-accelerated package of Aspose.OCR for .NET to your project....Installing GPU-accelearated package Contents [ Hide ] GPU-accelerated...engine requires a CUDA capable GPU and NVIDIA CUDA Toolkit . To...

    docs.aspose.com/ocr/net/installation/gpu/
    more..

  2. GPU not detected|Documentation

    Aspose.LLM for .NET runs on CPU when you expected Gpu, diagnose driver, acceleration selection, binary mismatch, GpuLayers setting....GPU not detected Contents [ Hide ] You wanted the SDK to use...use the GPU, but inference is slow and nvidia-smi (or equivalent)...

    docs.aspose.com/llm/net/troubleshooting/gpu-not...
    more..

  3. GPU deployment with CUDA|Documentation

    Deploy Aspose.LLM for .NET on NVIDIA Gpus, select CUDA, offload all layers, configure multi-Gpu split, and size VRAM for model + KV cache....GPU deployment with CUDA Contents [ Hide ] CUDA is the fastest...production GPU deployment: single GPU, multi-GPU, and VRAM sizing...

    docs.aspose.com/llm/net/use-cases/gpu-deploymen...
    more..

  4. Installing GPU-accelearated package|Documentation

    Adding Gpu-accelerated package of Aspose.OCR for C++ to your project....Installing GPU-accelearated package Contents [ Hide ] GPU-accelerated...engine requires a [CUDA capable GPU] and NVIDIA CUDA Toolkit . To...

    docs.aspose.com/ocr/cpp/installation/gpu/
    more..

  5. Installing GPU-accelearated package|Documentation

    Adding Gpu-accelerated package of Aspose.OCR for Java to your project....Installing GPU-accelearated package Contents [ Hide ] GPU-accelerated...engine requires a CUDA capable GPU and NVIDIA CUDA Toolkit . Aspose...

    docs.aspose.com/ocr/java/installation/gpu/
    more..

  6. Aspose OCR GPU only works with CUDA toolkit 11....

    My setup: Windows server 2019 and Visual Studio 2019 Aspose.OCR-Gpu v25.10.0 w/ lowest Dependency behavior OnnxRuntime.Gpu v 1.16.3 CUDA toolkit v 12.0.0 CuDNN v 8.8.0 Nvidia RTX 2000E driver v 552.74 I can only ge…...Aspose OCR GPU only works with CUDA toolkit 11.8 on Windows server...Visual Studio 2019 Aspose.OCR-GPU v25.10.0 w/ lowest Dependency...

    forum.aspose.com/t/aspose-ocr-gpu-only-works-wi...
    more..

  7. GpuLayers|Documentation

    Number of model layers to offload to Gpu in Aspose.LLM for .NET — 0 for CPU-only, 999 for full offload, partial for memory-tight Gpus....many transformer layers run on GPU. Each offloaded layer lives in...system RAM. The primary knob for GPU acceleration. Quick reference...

    docs.aspose.com/llm/net/developer-reference/par...
    more..

  8. SplitMode|Documentation

    Multi-Gpu model distribution in Aspose.LLM for .NET — None for single Gpu, Layer for layer-wise split, Row for tensor parallelism....multiple GPUs. Essential only on multi-GPU hosts; on single-GPU systems...LLAMA_SPLIT_MODE_ROW Category GPU distribution Field on ModelInferenceParame...

    docs.aspose.com/llm/net/developer-reference/par...
    more..

  9. MainGpu|Documentation

    Gpu device index in Aspose.LLM for .NET — selects which Gpu holds the model when SplitMode is None....[ Hide ] MainGpu selects the GPU device index used when SplitMode...SplitMode is None . On multi-GPU hosts, this picks which device holds...

    docs.aspose.com/llm/net/developer-reference/par...
    more..

  10. CUDA|Documentation

    Run Aspose.LLM for .NET on NVIDIA Gpus with CUDA acceleration — driver requirements, compute capability, single and multi-Gpu setup....on NVIDIA GPUs. It supports single-GPU and multi-GPU setups, aggressive...cpp feature set. Requirements GPU : NVIDIA with compute capability...

    docs.aspose.com/llm/net/developer-reference/acc...
    more..