Futurology

1776 readers

142 users here now

founded 1 year ago

MODERATORS

AI PCs flood the market. Their makers hope someone wants them; Despite 49% surge in shipments, buyers seem unconvinced. (www.theregister.com)

submitted 6 hours ago by [email protected] to c/[email protected]

29 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 2 points 4 hours ago (1 children)

Matrix multiplication is also largely what graphics cards do, I wonder how the npus are different.

[–] [email protected] 1 points 3 hours ago (1 children)

Modern graphics cards pack a lot of functionality. Shading units, Ray tracing, video encoding/deciding. NPU is just the part needed to accelerat Neural nets.

[–] [email protected] 2 points 3 hours ago (1 children)

But you can accelerate nural nets better with a GPU, right? They've got a lot more parallel matrix multiplication compute than any npu you can slap on a CPU.

[–] [email protected] 1 points 23 minutes ago

It all depends on the GPU. If it's something integrated in the CPU it will probably not so better, if it's a 2000$ dedicated GPU with 48GB of VRAM is will be very powerful for Neural Net computing. NPUs are most often implemented as small, low-power, embedded solutions. Their goal is not to compete with data centers or workstations, it's to enable some basic "AI" features on portable devices. E.g: "smart" camera with object recognition to give you alerts.