Sam Altman thinks the RAM sitting in your laptop is a bad use of a scarce resource. According to the OpenAI CEO, “From a global allocation perspective, actually, it’s quite terrible to have everybody have a bunch of the world’s limited supply of DRAM sitting in their own computer and being used five percent of the time.”
\n\nTom’s Hardware reports that Altman made the case for centralizing computer memory in data centers, rather than personal computers, during an interview over beers with the YouTube channel Cheeky Pint. About 29 minutes in, he turned to local inference, the practice of running open-source AI models directly on a personal computer instead of through a cloud service.
\n\nHis argument: data centers get far more value out of DRAM, the memory chips used for short-term data storage and processing, than individual computers do. “From a global allocation perspective, actually, it’s quite terrible to have everybody have a bunch of the world’s limited supply of DRAM sitting in their own computer and being used 5 percent of the time,” he said.
\n\nHe framed it as a supply and demand problem. “You want maximum utilization in the cloud if you’re trying to deal with this very…
Original source: https://www.breitbart.com/economy/
