Huawei has launched its Unified Cache Manager (UCM), a software framework designed to speed up inference in large AI models. The company says the tool could lower costs and reduce China's dependence on costly high-bandwidth memory (HBM) chips.
The article requires paid subscription.
Subscribe Now