Why is the United States attempting to prevent China from accessing high-bandwidth memory?
The selling of advanced memory chips used in artificial intelligence (AI) applications to China is now subject to new export restrictions enforced by the US government. Both foreign-made and US-made high bandwidth memory (HBM) technologies are subject to the regulations.
Here is everything you need to know about these innovative semiconductors, whose demand has skyrocketed in tandem with the global AI craze.
HBM: What is it?
A new kind of computer memory called High Bandwidth Memory (HBM) is made to be both high-bandwidth and low-power. 3D stacking technology is used by HBM. In high-performance computing applications where that data speed is necessary, it will usually be appropriate and utilized.
3D stacking technology is used by HBM. This allows for the stacking of multiple chip layers on top of one another via vertical channels known as TSVs (through-silicon vias). As a result, data must travel less distance between the memory and CPU since more memory chips may be crammed into a smaller area.
What are its main Benefits?
- Reduced power usage: It’s just more power-efficient. For precisely this reason, HBM can assist prolong battery life and lower energy consumption by lowering the power required to transmit data between memory and processor. This has obvious sustainability implications.
- Greater capacity: Use HBM to store and process more data simultaneously. This is the way of the future for server-based applications that need a lot of data processing, like AI and machine learning. The same is true for more private tasks like editing and producing videos.
- Smaller form factor: We are searching for methods to lessen our footprint as everything expands. By employing 3D stacking technology, HBM makes it possible to stack numerous memory chip layers on top of one another, minimizing the footprint. crucial for devices like notebooks and smartphones.
Why does HBM matter so much?
HBM chips are more powerful than conventional memory chips mainly because they have more storage space and transmit data at a much faster rate. Since AI applications need a lot of sophisticated computation, these characteristics guarantee that they function without hiccups or delays. More storage capacity allows for the processing, transmission, and storage of more data, which improves the performance of AI applications by giving large language models (LLM) more parameters to train on.
Consider the increased bandwidth, or faster pace of data transmission, as a freeway. A highway can handle more automobiles if it has more lanes because bottlenecks are less likely to occur.
How is HBM produced?
Consider arranging several common memory chips in a hamburger-like stack. In essence, that is how HBM is structured. Although it seems straightforward enough on the surface, it is a difficult task to complete, to the point that the cost is affected. HBM is sold for several times more per unit than a typical memory chip.
Because of this, each layer of those conventional memory chips that are stacked together must also be incredibly thin, a task that requires superior manufacturing skills called as advanced packaging. An HBM is about as tall as six strands of hair.
How will China be affected by the restrictions?
To prevent China from gaining access to vital technology that could provide it with a military advantage, the Biden administration has already issued two rounds of advanced chip export limits over three years. The most recent round of export restrictions was announced on December 2. China responded by enacting further restrictions on the export of elements such as gallium and germanium, which are necessary for the production of semiconductors and other high-tech devices. The two biggest memory chip producers in China are Yangtze Memory Technologies and Changxin Memory Technologies. According to reports, they are increasing their capability to construct HBM production lines to achieve their strategic objective of technological self-sufficiency.