N環球 N GLOBE
US Technology

Phison shows SSD with built-in NPU that runs AI on the drive

· N GLOBE

At the SC26 supercomputing conference in Chicago, Phison showed a computational storage design that puts a neural processing unit and 64GB of memory inside an SSD, so AI frameworks such as PyTorch can run on the drive and move less data.

SSD controller maker Phison has shown a computational storage design at the SC26 supercomputing conference in Chicago: a neural processing unit (NPU) and 64GB of memory built directly into a solid-state drive, so AI work can run where the data lives instead of moving whole datasets to a server processor first.

Less data to move: transfers cut 10 to 100 times

According to Tom's Hardware and TechSpot, the design's NPU is rated at 36,800 DMIPS, with memory bandwidth of 130GB/s, and it supports familiar AI frameworks including PyTorch, vLLM, OpenVINO and llama.cpp, with no specialised programming tools needed. Phison says the approach can cut data transfers by 10 to 100 times on suitable workloads, while also easing the load on the host CPU.

Phison also showed its next-generation PCIe Gen6 enterprise controller, the PS5303, targeting sequential throughput of up to 28GB/s and 6.8 million IOPS, plus the PS7161, the first PCIe 6.0 redriver on the PCI-SIG Integrators List. PCIe Gen6 doubles the per-lane rate to 64 GT/s.

Still an architecture proposal, with no launch date

Phison has not named the AI-capable drive or given a sampling or launch date, and says many of the products and features shown remain in development. TechSpot notes that for now this is more of an architecture proposal than a product a data centre can order, aimed at AI training clusters and supercomputers.

💬 Comments

No comments yet. Be the first!