• raldone01@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    3 months ago

    My specs because you asked:

    CPU: Intel(R) Xeon(R) E5-2699 v3 (72) @ 3.60 GHz
    GPU 1: NVIDIA Tesla P40 [Discrete]
    GPU 2: NVIDIA Tesla P40 [Discrete]
    GPU 3: Matrox Electronics Systems Ltd. MGA G200EH
    Memory: 66.75 GiB / 251.75 GiB (27%)
    Swap: 75.50 MiB / 40.00 GiB (0%)
    
      • raldone01@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        3 months ago

        Each card has 24GB so 48GB vram total. I use ollama it fills whatever vrams is available on both cards and runs the rest on the CPU cores.