Avieshek@lemmy.world to Technology@lemmy.worldEnglish · 3 months agoEdward Snowden slams Nvidia's RTX 50-series 'F-tier value,' whistleblows on lackluster VRAM capacitywww.tomshardware.comexternal-linkmessage-square88fedilinkarrow-up1106arrow-down129
arrow-up177arrow-down1external-linkEdward Snowden slams Nvidia's RTX 50-series 'F-tier value,' whistleblows on lackluster VRAM capacitywww.tomshardware.comAvieshek@lemmy.world to Technology@lemmy.worldEnglish · 3 months agomessage-square88fedilink
minus-squareTeamAssimilation@infosec.publinkfedilinkEnglisharrow-up69·3 months agoEdward Snowden doing GPU reviews? This timeline is becoming weirder every day.
minus-squareGamingChairModel@lemmy.worldlinkfedilinkEnglisharrow-up19·3 months ago“Whistleblows” as if he’s some kind of NVIDIA insider.
minus-square0x0@programming.devlinkfedilinkEnglisharrow-up1·3 months agoIntel Insider now that would’ve made for great whistleblowing headlines.
minus-squareWinged_Hussar@lemmy.worldlinkfedilinkEnglisharrow-up8·3 months agoLegitimately thought this was a hard-drive.net post
minus-squareEager Eagle@lemmy.worldlinkfedilinkEnglisharrow-up5·3 months agoI bet he just wants a card to self host models and not give companies his data, but the amount of vram is indeed ridiculous.
minus-squareJeena@piefed.jeena.netlinkfedilinkEnglisharrow-up4·3 months agoExactly, I’m in the same situation now and the 8GB in those cheaper cards don’t even let you run a 13B model. I’m trying to research if I can run a 13B one on a 3060 with 12 GB.
minus-squareThe Hobbyist@lemmy.ziplinkfedilinkEnglisharrow-up4·3 months agoYou can. I’m running a 14B deepseek model on mine. It achieves 28 t/s.
minus-squareJeena@piefed.jeena.netlinkfedilinkEnglisharrow-up1·3 months agoOh nice, that’s faster than I imagined.
minus-squarelevzzz@lemmy.worldlinkfedilinkEnglisharrow-up1·3 months agoYou need a pretty large context window to fit all the reasoning, ollama forces 2048 by default and more uses more memory
minus-squaresecret300@lemmy.sdf.orglinkfedilinkEnglisharrow-up4·3 months agoSwear next he’s gonna review hentai games Oh wait… https://www.youtube.com/watch?v=fAf1Syz17JE
minus-squarenewcockroach@lemmy.worldlinkfedilinkEnglisharrow-up2·3 months ago“Some hentai games are good” -Edward Snowden
minus-squareSiegfried@lemmy.worldlinkfedilinkEnglisharrow-up2·3 months agoNote that this is from 2003
Edward Snowden doing GPU reviews? This timeline is becoming weirder every day.
“Whistleblows” as if he’s some kind of NVIDIA insider.
Intel Insider now that would’ve made for great whistleblowing headlines.
Legitimately thought this was a hard-drive.net post
I bet he just wants a card to self host models and not give companies his data, but the amount of vram is indeed ridiculous.
Exactly, I’m in the same situation now and the 8GB in those cheaper cards don’t even let you run a 13B model. I’m trying to research if I can run a 13B one on a 3060 with 12 GB.
You can. I’m running a 14B deepseek model on mine. It achieves 28 t/s.
Oh nice, that’s faster than I imagined.
You need a pretty large context window to fit all the reasoning, ollama forces 2048 by default and more uses more memory
Swear next he’s gonna review hentai games
Oh wait… https://www.youtube.com/watch?v=fAf1Syz17JE
“Some hentai games are good” -Edward Snowden
Note that this is from 2003