misk@sopuli.xyz to Technology@lemmy.worldEnglish · 1 year agoFramework’s first desktop is a strange—but unique—mini ITX gaming PCarstechnica.comexternal-linkmessage-square285linkfedilinkarrow-up1647arrow-down110
arrow-up1637arrow-down1external-linkFramework’s first desktop is a strange—but unique—mini ITX gaming PCarstechnica.commisk@sopuli.xyz to Technology@lemmy.worldEnglish · 1 year agomessage-square285linkfedilink
minus-squareToes♀@ani.sociallinkfedilinkEnglisharrow-up2·1 year agoWould 256GB/s be too slow for large llms?
minus-squareActers@lemmy.worldlinkfedilinkEnglisharrow-up2·1 year agoMany LLM operations rely on fast memory and gpus seem to have that. Even though their memory is soldered and vbios is practically a black box that is tightly controlled. Nothing on a GPU is modular or repairable without soldering skills(and tools).
Would 256GB/s be too slow for large llms?
It runs on the gpu
Many LLM operations rely on fast memory and gpus seem to have that. Even though their memory is soldered and vbios is practically a black box that is tightly controlled. Nothing on a GPU is modular or repairable without soldering skills(and tools).
Huh?