AMD has recently compared its own Ryzen 7 7840U mobile processor (nominal power consumption of 15 W) and Intel’s Core Ultra 7 155H ( TDP is 28 W), the former is obviously better.
AMD compared two large language models, Meta’s Llama 2 7B and Mistral Instruct 7B (co-developed by Meta and DeepMind), mainly measuring the Time to the first token (that is, the time from sending the prompt word to the model’s response) and each The number of tokens that can be transferred per second.
AMD said that in order to solve AI problems, Ryzen processors can use three cores: dedicated artificial intelligence engine NPU, integrated graphics core RDNA 3 and Zen 4 computing core. IT Home attaches pictures as follows:
AMD also said the Ryzen 7 7840U processor is ahead of competitors in AI tasks by supporting AVX512 and VNNI instructions. Intel previously offered support for these instructions in consumer chips, but later abandoned them.
