☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to Technology@lemmygrad.mlEnglish · 5 days agoDeepSeek-V3 now runs at 20 tokens per second on Mac Studio, and that’s a nightmare for OpenAIventurebeat.comexternal-linkmessage-square15fedilinkarrow-up138arrow-down11cross-posted to: [email protected]
arrow-up137arrow-down1external-linkDeepSeek-V3 now runs at 20 tokens per second on Mac Studio, and that’s a nightmare for OpenAIventurebeat.com☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to Technology@lemmygrad.mlEnglish · 5 days agomessage-square15fedilinkcross-posted to: [email protected]
minus-squarePhilo_and_sophy@lemmygrad.mllinkfedilinkEnglisharrow-up10·4 days agoMore than turning a profit, they could bend the arc of ai’s climate crisis by competing in this domain of efficiency 32 gpus -> 1 gpu loosely translates to a 10x reduction in water and energy needed for interference after the 100x reduction in training requirements. And these are just the improvements within 4 months…
More than turning a profit, they could bend the arc of ai’s climate crisis by competing in this domain of efficiency
32 gpus -> 1 gpu loosely translates to a 10x reduction in water and energy needed for interference after the 100x reduction in training requirements.
And these are just the improvements within 4 months…