#ddr5

#ddr5

DDR5 isn't normally associated with AI accelerators. Those typically employ GDDR or HBM, which trade capacity for the higher bandwidth required for those workloads. However, the systems into which these accelerators are deployed do use DRR5 for the system memory to feed the CPU and to store intermediary data, like the key value caches used to prolong a model's short-term memory over extended periods.