minus-squaredonatas@feddit.ukOPtoSelfhosted@lemmy.world•Some local LLMs tested on an average gaming PClinkfedilinkEnglisharrow-up4·1 month ago128GB won’t make any difference in gaming when compared to, say, 32GB, so it’s just to fit larger LLMs into memory. However, 0.5t/s is hardly usable for every day tasks, so 32GB will still be more realistic combination with the RTX4070. linkfedilink
minus-squaredonatas@feddit.ukOPtoSelfhosted@lemmy.world•Some local LLMs tested on an average gaming PClinkfedilinkEnglisharrow-up5·1 month agoPerformance/vision based tests have tokens/s at the end of tables. linkfedilink
donatas@feddit.uk to Selfhosted@lemmy.worldEnglish · 1 month agoSome local LLMs tested on an average gaming PCplus-squaregithub.comexternal-linkmessage-square17linkfedilinkarrow-up163arrow-down119
arrow-up144arrow-down1external-linkSome local LLMs tested on an average gaming PCplus-squaregithub.comdonatas@feddit.uk to Selfhosted@lemmy.worldEnglish · 1 month agomessage-square17linkfedilink
donatas@feddit.uk to Buy European@feddit.ukEnglish · 1 month agoSelf-hosting web services (email, www etc) as an alternative reminderplus-squarewww.reddit.comexternal-linkmessage-square10linkfedilinkarrow-up147arrow-down11
arrow-up146arrow-down1external-linkSelf-hosting web services (email, www etc) as an alternative reminderplus-squarewww.reddit.comdonatas@feddit.uk to Buy European@feddit.ukEnglish · 1 month agomessage-square10linkfedilink
128GB won’t make any difference in gaming when compared to, say, 32GB, so it’s just to fit larger LLMs into memory. However, 0.5t/s is hardly usable for every day tasks, so 32GB will still be more realistic combination with the RTX4070.