Search
Sort Score
Result 10 results
Languages All
Labels All
Results 31 - 40 of 304 for

gpu

(0.17 sec)

  1. System requirements|Documentation

    Minimum requirements and prerequisites for developing applications with Aspose.OCR for C++....29 or later GPU support To use Aspose.Ocr.Cpp-GPU you will need...need a CUDA capable GPU and NVIDIA CUDA Toolkit . Read Installation...

    docs.aspose.com/ocr/cpp/system-requirements/
    more..

  2. Estimate memory requirements|Documentation

    Predict RAM and VRAM use for Aspose.LLM for .NET, model weights, KV cache, projector, intermediate buffers. Worked examples for common presets....examples Qwen25Preset on a 12 GB GPU Weights (7B Q4_K_M): 3.5 GB KV...Qwen3Preset at full 32K on a 16 GB GPU Weights (8B Q4_K_M): 4 GB KV...

    docs.aspose.com/llm/net/how-to/estimate-memory-...
    more..

  3. Quick wins|Documentation

    Five compact recipes for common Aspose.LLM for .NET tasks, first message, image input, session save/restore, CPU-only run, and CUDA Gpu run....does not have a twin, drive the GPU preset directly and set GpuLayers...Expect lower throughput than GPU inference; a 7B Q4 model typically...

    docs.aspose.com/llm/net/quick-wins/
    more..

  4. External dependencies|Documentation

    Third-party components used by Aspose.OCR for .NET....Gpu version 1.16.3 (for Aspose.OCR-GPU only). Aspose...install Aspose.OCR / Aspose.OCR-GPU for .NET NuGet package. You will...

    docs.aspose.com/ocr/net/third-party/
    more..

  5. System requirements|Documentation

    Supported .NET runtimes, operating systems, CPU and Gpu requirements, and disk/RAM sizing for Aspose.LLM for .NET....substantial RAM and preferably GPU acceleration. No built-in LLM...native ARM binaries. GPU (optional) GPU acceleration is optional...

    docs.aspose.com/llm/net/system-requirements/
    more..

  6. Use cases|Documentation

    End-to-end scenarios with runnable code for Aspose.LLM for .NET, simple chat, multi-turn conversations, session persistence, and custom presets....: no GPU, tune threads, set realistic expectations. GPU deployment...with CUDA : NVIDIA GPUs, single and multi-GPU. Integration with...

    docs.aspose.com/llm/net/use-cases/
    more..

  7. Hardware Based Rendering of 3D Geometry|Documen...

    Using Aspose.3D for Python via .NET API, developers can program the Gpu (graphics processing unit) and setup the graphics hardware for rendering 3D geometry instead of the fixed function pipeline.... developers can program the GPU (graphics processing unit) and...calculate the final pixel color in GPU side Render States - It provides...

    docs.aspose.com/3d/python-net/hardware-based-re...
    more..

  8. Aspose.LLM for .NET|Documentation

    Aspose.LLM for .NET is a library for on-premise LLM integration, chat sessions, vision input, and model presets....run them locally — on CPU or GPU, without calling a hosted inference...concurrent sessions CPU-only , CUDA GPU , offline , ASP.NET Core Long...

    docs.aspose.com/llm/net/
    more..

  9. Tune for speed vs quality|Documentation

    Move a preset along the speed-quality curve in Aspose.LLM for .NET, model size, quantization, sampler, context, Gpu offload....50-100 tokens/sec on a mid-range GPU, 15-30 on modern CPU. Quality-biased...10-30 tokens/sec on a high-end GPU. CPU not recommended. Balanced...

    docs.aspose.com/llm/net/how-to/tune-for-speed-v...
    more..

  10. Out of memory|Documentation

    Fix out-of-memory errors in Aspose.LLM for .NET, Gpu VRAM, system RAM, KV cache growth, swap thrashing.... On GPU: nvidia-smi showing the process...cudaErrorOutOfMemory , hipErrorOutOfMemory GPU VRAM System.OutOfMemoryException...

    docs.aspose.com/llm/net/troubleshooting/out-of-...
    more..