GDDR5X Standard Finalized by JEDEC: New Graphics Memory up to 14 Gbps
by Anton Shilov on January 22, 2016 3:00 PM ESTIn Q4 2015, JEDEC (a major semiconductor engineering trade organization that sets standards for dynamic random access memory, or DRAM) finalized the GDDR5X specification, with accompianing white papers. This is the memory specification which is expected to be used for next-generation graphics cards and other devices. The new technology is designed to improve bandwidth available to high-performance graphics processing units without fundamentally changing the memory architecture of graphics cards or memory technology itself, similar to other generations of GDDR, although these new specifications are arguably pushing the phyiscal limits of the technology and hardware in its current form.
The GDDR5X SGRAM (synchronous graphics random access memory) standard is based on the GDDR5 technology introduced in 2007 and first used in 2008. The GDDR5X standard brings three key improvements to the well-established GDDR5: it increases data-rates by up to a factor of two, it improves energy efficiency of high-end memory, and it defines new capacities of memory chips to enable denser memory configurations of add-in graphics boards or other devices. What is very important for developers of chips and makers of graphics cards is that the GDDR5X should not require drastic changes to designs of graphics cards, and the general feature-set of GDDR5 remains unchanged (and hence why it is not being called GDDR6).
Performance Improvements
Nowadays highly binned GDDR5 memory chips can operate at 7 Gbps to 8 Gbps data rates. While it is possible to increase performance of the GDDR5 interface for command, address and data in general, according to Micron Technology, one of the key designers of GDDR5X, there are limitations when it comes to array speed and command/address protocols. In a bid to improve performance of the GDDR5 memory, engineers had to change internal architecture of memory chips significantly.
The key improvement of the GDDR5X standard compared to the predecessor is its all-new 16n prefetch architecture, which enables up to 512 bit (64 Bytes) per array read or write access. By contrast, the GDDR5 technology features 8n prefetch architecture and can read or write up to 256 bit (32 Bytes) of data per cycle. Doubled prefetch and increased data transfer rates are expected to double effective memory bandwidth of GDDR5X sub-systems. However, actual performance of graphics cards will depend not just on DRAM architecture and frequencies, but also on memory controllers and applications. Therefore, we will need to test actual hardware to find out actual real-world benefits of the new memory.
Just like the predecessor, GDDR5X functions with two different clock types - a differential command clock (CK) to where address and command inputs are referenced, as well as a forwarded differential write clock (WCK) where read and write data are referenced to. WCK runs at a frequency that is two times higher than the CK. The data can be transmitted at double data rate (DDR) or quad data rate (QDR) relative to the differential write clock (WCK), depending whether 8n prefetch or 16n prefetch architecture and protocols are used. Accordingly, if makers of chips manage to increase CK clock to 1.5 GHz, then data rate in QDR/16n mode will rise to 12 Gbps.
Since the GDDR5X protocol and interface training sequence are similar to those of the GDDR5, it should be relatively easy for developers of chips to adjust their memory controllers to the new type of memory. However, since the QDR mode (which is called Ultra High Speed mode in Micron’s materials) mandates usage of PLLs/DLLs (Phase Locked Loops, Delay Locked Loops), there will be certain design changes to design of high-end memory chips.
JEDEC’s GDDR5X SGRAM announcement discusses data rates from 10 to 14 Gbps, but Micron believes that eventually they could be increased to 16 Gbps. It is hard to say whether commercial chips will actually hit such data rates, keeping in mind that there are new types of memory incoming. However, even a 256-bit GDDR5X memory sub-systems running at 14 Gbps could provide up to 448 GBps of memory bandwidth, just 12.5% lower compared to that of AMD’s Radeon R9 Fury X (which uses first-gen HBM).
GPU Memory Math | |||||||||
AMD Radeon R9-290X |
NVIDIA GeForce GTX 980 Ti |
NVIDIA GeForce GTX 960 |
AMD Radeon R9 Fury X |
Samsung's 4-Stack HBM2 based on 8 Gb DRAM | Theoretical GDDR5X 256-bit sub-system |
Theoretical GDDR5X 128-bit sub-system |
|||
Total Capacity | 4 GB | 6 GB | 2 GB | 4 GB | 16 GB | 8 GB | 4 GB | ||
B/W Per Pin | 5 Gb/s | 7 Gb/s | 7 Gb/s | 1 Gb/s | 2 Gb/s | 14 Gb/s | 14 Gb/s | ||
Chip capacity | 2 Gb | 4 Gb | 4 Gb | 1 GB | 4 GB | 1 GB (8 Gb) |
1 GB (8 Gb) |
||
No. Chips/Stacks | 16 | 12 | 4 | 4 | 4 | 8 | 4 | ||
B/W Per Chip/Stack | 20 GB/s |
28 GB/s |
28 GB/s |
128 GB/s |
256 GB/s |
56 GB/s |
56 GB/s |
||
Bus Width | 512-bit | 384-bit | 128-bit | 4096-bit | 4096-bit | 256-bit | 128-bit | ||
Total B/W | 320 GB/s |
336 GB/s |
112 GB/s |
512 GB/s |
1 TB/s |
448 GB/s |
224 GB/s |
||
Estimated DRAM Power Consumption |
30 W | 31.5 W | 10 W | 14.6 W | n/a | 20 W | 10 W |
Capacity Improvements
Performance was not the only thing that developers of the GDDR5X had to address. Many applications require not only high-performance memory, but a lot of high-performance memory. Increased capacities of GDDR5X chips will enable their adoption by broader sets of devices in addition to graphics/compute cards, game consoles and network equipment as well as other areas. Initially one would expect the high density configurations to be slightly conservative on frequency to begin with.
The GDDR5 standard covered memory chips with 512 Mb, 1 Gb, 2 Gb, 4 Gb and 8 Gb capacities. The GDDR5X standard defines devices with 4 Gb, 6 Gb, 8 Gb, 12 Gb and 16 Gb capacities. Typically, mainstream DRAM industry tends to double capacities of memory chips because of economic and technological reasons. However, with GDDR5X the industry decided to ratify SGRAM configurations with rather unusual capacities — 6Gb and 12Gb.
The mobile industry already uses LPDDR devices with 3 Gb, 6 Gb and 12 Gb capacities in a bid to maximize flexibility of memory configurations for portable electronics. As it appears, companies developing standards for graphics DRAM also wanted to capitalize on flexibility. A GDDR5X chip with 16 Gb capacity made using 20 nm or 16/18 nm process technology would have a rather large die size and thus high cost. However, the size and cost of a 12 Gb DRAM IC should be considerably lower and such a chip could arguably address broader market segments purely on cost.
Just like in case of the GDDR5, the GDDR5X standard fully supports clamshell mode, which allows two 32-bit memory chips to be driven by one 32-bit memory controller by sharing address and command bus while reducing the number of DRAM IC’s I/Os to 16. Such operation has no impact on system bandwidth, but allows doubling the amount of memory components per channel. For example, it should be theoretically possible to build a graphics card with 64 GB of GDDR5X using one GPU with a 512-bit memory bus as well as 32 16 Gb GDDR5X memory chips.
Unusual capacities will help GDDR5X to better address all market segments, including graphics cards, HPC (high performance computing), game consoles, network equipment and so on. However, it should be noted that the GDDR5X has extremely potent rival, the second-gen HBM, which offers a number of advantages, especially in the high-end segment of the graphics and HPC markets.
Energy Efficiency
Power consumption and heat dissipation are two major limiting factors of compute performance nowadays. When developing the GDDR5X standard, the industry implemented a number of ways to keep power consumption of the new graphics DRAM in check.
Supply voltage and I/O voltages of the GDDR5X were decreased from 1.5V on today’s high-end GDDR5 memory devices to 1.35V. Reduction of Vdd and Vddq should help to cut power consumption of the new memory by up to 10%, which is important for high-performance and mobile devices where the memory can take a sizable chunk of the available power budget.
The reduction of supply and I/O voltages is not the only measure to cut power consumption of the new memory. The GDDR5X standard makes temperature sensor controlled refresh rate a compulsory feature of the technology, something that could help to optimize power consumption in certain scenarios. Moreover, there are a number of other features and commands, such as per-bank self refresh, hibernate self refresh, partial array self refresh and other, that were designed to shrink the energy consumption of the new SGRAM.
Due to lower voltages and a set of new features, power consumption of a GDDR5X chip should be lower compared to that of a GDDR5 chip at the same clock-rates. However, if we talk about target data rates of the GDDR5X, then power consumption of the new memory should be similar or slightly higher than that of GDDR5, according to Micron. The company says that GDDR5X’s power consumption is 2-2.5W per DRAM component and 10-30W per board. Even with similar/slightly higher power consumption compared to the GDDR5, the GDDR5X is being listed as considerably more energy efficient due to its improved theoretical performance.
We do not know specifications of next-generation graphics adapters (for desktops and laptops) from AMD and NVIDIA, but if developers of GPUs and DRAMs can actually hit 14 Gb/s data-rates with GDDR5X memory, they will double the bandwidth available to graphics processors vs GDDR5 without significantly increasing power consumption. Eventually, more efficient data-rates and unusual capacities of the GDDR5X could help to actually decrease power consumption of certain memory sub-systems.
Implementation
While internally a GDDR5X chip is different from a GDDR5 one, the transition of the industry to GDDR5X is a less radical step than the upcoming transition to the HBM (high-bandwidth memory) DRAM. Moreover, even the transition from the GDDR3/GDDR4 to the GDDR5 years ago was considerably harder than transition to the GDDR5X is going to be in the coming years.
The GDDR5X-compliant memory chips will come in 190-ball grid array packaging (as compared to 170-ball packaging used for current GDDR5), thus, they will not be pin-to-pin compatible with existing GDDR5 ICs or PCBs for modern graphics cards. But while the GDDR5X will require development of new PCBs and upgrades to memory controllers, everything else works exactly like in case of the GDDR5: the interface signal training features and sequences are the same, error detection is similar, protocols have a lot of resemblances, even existing GDDR5 low and high speed modes are supported to enable mainstream and low-power applications. BGA packages are inexpensive, and they do not need silicon interposers nor use die-stacking techniques which HBM requires.
Implementation of GDDR5X should not be too expensive both from R&D and production perspectives; at least, this is something that Micron implied several months ago when it revealed the first details about the technology.
Industry Support
The GDDR5X is a JEDEC standard supported by its members. The JEDEC’s document covering the technology contains vendor IDs for three major DRAM manufacturers: Micron, Samsung and SK Hynix. Identification of the memory producers are needed for controllers to to differentiate between various vendors and different devices, and listing the memory makers demonstrates that they participated in development, considered features and balloted on them at JEDEC’s meetings, which may indicate their interest in supporting the technology. Unfortunately, exact plans for each of the companies regarding GDDR5X production are unknown, though we would expect GDDR5X parts to fit between the current GDDR5 high end and anything implementing HBM, or for implementing higher memory capacity on lower end GPUs. Micron plans to start mass production of its GDDR5X memory chips in mid-2016, so we might see actual GDDR5X-based memory sub-systems in less than six months from now.
NVIDIA, currently the world’s largest supplier of discrete graphics processors, said that that as a member of JEDEC it participates in the development of industry standards like GDDR5X. AMD is also a member of JEDEC and it usually plays a key role in development of memory standards. Both of these companies also employ compression algorithms to allieviate the stress on texture transfers between the GPU and memory, and thus an increase in bandwidth (as shown by Fiji) plus an increase in density can see benefits in texture rich or memory bound compute scenarios.
While specific plans of various companies regarding the GDDR5X are unclear, the technology has a great potential if the numbers are accurate (it has to be, it's a standard) and has all chances to be adopted by the industry. The main rival of the GDDR5X, second-generation HBM, can offer higher bandwidth, lower power consumption and smaller form-factors, but at the cost of design and manufacturing complexities. In fact, what remains to be seen is whether the HBM and the GDDR5X will actually compete directly against each other or will just become two complementary types of memory. Different applications nowadays have different requirements, and an HBM memory sub-system with 1 TBps of bandwidth makes a perfect sense for a high-end graphics adapter. However mainstream video cards should work perfectly with GDDR5X, and chances are we will see both in play at different market focal points.
Source: JEDEC
70 Comments
View All Comments
Samus - Sunday, January 24, 2016 - link
Do you have anything constructive to contribute other than trolling all of my posts Yojimbo? You didn't even respond to what I wrote. GDDR5X and HBM are the same size (they're both built on the same process node) it's just that HBM is vertical and DDR is planar. HBM requires a thick PCB because of the interposer layer and additional packaging, making it unrealistic for embedded solutions in the near term. That's why not a single one has been announced.As far as power consumption? Did you not read the chart? GDDR5X reduced power consumption significantly, and since we don't even know what HBM2 is rated at yet, it's safe to assume after added power consumption of the interposer, package substrate and more complex memory controller, they're virtually equal albeit HBM2 is significantly faster. But as it stands, the performance isn't even needed and won't be needed for some time.
Yojimbo - Sunday, January 24, 2016 - link
I did respond to what you wrote. You replied to DanNeely, dismissing his notion that HBM may be used in mobile applications because GDDR5X is likely to perform well enough. I wrote in support of what he said by saying that performance is not the only thing to consider.By mobile, I assume DanNeely is talking about laptops. Why would a GP104 or GP106 or any other "mid-level GPU" be in an SOC?
GDDR5X chips and HBM chips do not take up the same PCB footprint. Here you can see the thickness of the R9 Nano PCB: http://images.hardwarecanucks.com/image//skymtl/GP... Here you can see how the RAM chips are not high: http://images.hardwarecanucks.com/image//skymtl/GP... It doesn't look unrealistic to put it in a laptop.
It's easy to imagine that nothing has been announced as far as using HBM in mobile because 1) NVIDIA isn't using HBM yet and the only thing they've specifically paired it with in their presentations so far are mezzanine boards, as far as I know, and 2) AMD neither has a mobile presence nor deep pockets at the moment. An attack on the high end desktop space was probably a better strategic choice than suddenly trying to chase OEMs for contracts to get into laptops while there were limited HBM chips.
I see nothing in that chart that suggests that GDDR5X, while more power efficient than GDDDR5, can be "safely assumed" to be as power efficient as HBM 2. Not sure why you think the HBM interposer or packaging or even memory controller is going to consume more power than the PCB traces, packaging, and memory controller that GDDRX5 uses. I haven't seen anything about that. In fact, from an EETimes article: http://www.eetimes.com/author.asp?section_id=36&am... "Stacking ICs that communicate with one another to minimize the signal interconnect is an emerging trend in low-power design. We have seen several cases where processors and memory are stacked over a silicon interposer that makes connections using Through Silicon Vias (TSV). These interposers provide a low capacitance signal interconnect between die, thus reducing the I/O active power consumption."
I'm not sure why you think I'm attacking you just because I am disagreeing with you. I wouldn't be surprised at all if HBM2 is hardly seen outside the compute market (I would be surprised if HBM2 isn't seen heavily in the compute market) in 2016. A lot has to do with pricing and availability of GDDR5, GDDR5X, and HBM2. My point was that performance is not the only consideration. High performance laptops are likely not very cost sensitive, so saving on power and space may be worth the higher cost. So I think DanNeely's suggestion seems plausible at this point.
Samus - Monday, January 25, 2016 - link
tl/drSee ya back here in a few years to discuss all those laptops you're saying HBM-equipped GPU's will be in...
h4rm0ny - Tuesday, January 26, 2016 - link
>>"tl/dr"Too long for you, maybe. But I read it and found it a very interesting post. Thank you for writing it, Yojimbo.
DanNeely - Monday, January 25, 2016 - link
If nothing else, TDP not spent on GDDR can be spent on bumping the GPU clock for a bit of extra speed.Alexvrb - Saturday, January 30, 2016 - link
Samus, you're missing the point. It's actually super easy to saturate GDDR5X. You take the extra bandwidth and shrink the memory bus and make a smaller/cheaper/lower power chip with the same performance as last-gen tech. So yes, there will be some wide-bus implementations that really don't need all the bandwidth... but there will be mid-range and lower chips that really could use more bandwidth, but due to power, temp, and cost constraints they make due with a narrower bus.In any case where the bus isn't that wide (again, cards on a budget), IF there was two different versions (GDDR5 vs GDDR5X) marketed under the same name, there could and probably would be a performance difference. Now, generally the high-end cards are strictly using the faster memory anyway. If you look at cards with DDR vs GDDR for example, historically this has been something that happened in mid or low-end cards. Right where you would end up with narrower buses! So the likelihood of performance differences is high... just like it has been in the past.
The differences won't be nearly as vast as DDR vs GDDR days, however.
Lolimaster - Tuesday, January 26, 2016 - link
AMD plans to use HBM from top to bottom including APU's as soon as possible.Oxford Guy - Friday, January 22, 2016 - link
The word latency doesn't appear anywhere.We know DDR4 RAM on the desktop uses less voltage than DDR3 but despite the speed increase — latency increased a lot to compensate for that voltage reduction.
Is it that latency is immaterial for GPU RAM?
emn13 - Friday, January 22, 2016 - link
"A lot" being on the order of going from 5.6 to 6.6 nanoseconds for decent (not absolutely top-of-the line gear). Higher end stuff appears to differ less, including a DDR4 kit advertised at 3Ghz 15CL which would be just 5ns of latency (which may be almost too good to be true).There does seem to be a mild increase in latency, but nothing to write home about - though prices are still clearly higher.
Gigaplex - Saturday, January 23, 2016 - link
That's still a 15%-20% increase in latency. That's pretty significant, especially for latency dependent workloads.