U DON'T REALLY NEED 1.5TB PER CPU FOR TRAINING, CHATBOT INTERACTIONS, AND LIGHT AGENTIC WORKLOADS
What changed
THE FALL IS SO STUPID
U DON'T REALLY NEED 1.5TB PER CPU FOR TRAINING, CHATBOT INTERACTIONS, AND LIGHT AGENTIC WORKLOADS
PROVISIONING THAT MUCH DRAM FOR THEM WILL JUST LEAD TO UNDERUTILIZATION AND WASTE OF RESOURCES (500GB-750GB PER CPU IS ENOUGH)
MY BIGGEST FEAR WAS NVIDIA BEING UNABLE TO SELL FINISHED RUBIN NVL72 RACKS BECUZ OF THE DRAM SHORTAGE
NOW THEY CAN HANDLE DEMAND IN A MUCH BETTER WAY — VIA @ZEPHYR_Z9