Chips

Nvidia Consumer GPUs Unlocked: Firmware Hack Removes AI Performance Throttle

A firmware exploit discovered by modders bypasses Nvidia's intentional half-speed limitation on tensor operations across RTX 20, 30, and 40-series cards, though real-world gains fall short of peak theoretical improvements.

1 min read
Nvidia RTX 20, 30, and 40-series GPUs hacked to remove a half-speed AI throttle

Nvidia's consumer graphics cards have long operated under artificial performance constraints that limit their artificial intelligence capabilities. Researchers tinkering with the hardware have now found a firmware-level workaround that disables these restrictions on RTX 20, 30, and 40-series GPUs, according to VideoCardz. The modification allows the RTX 4090 to reach twice its official peak tensor throughput, while matrix computation performance on the RTX 3090 Ti can jump by as much as 80 percent, with intermediate results across the remaining affected models.

The practical impact, however, proves less dramatic than the raw numbers suggest. Actual applications see considerably smaller performance gains than the RTX 4090's theoretical doubling would indicate, and speeds for language model inference remain largely unchanged, since those operations are constrained by memory access rates rather than raw computational power.

Nvidia deliberately capped FP32-accumulate operations at half the FP16-accumulate rate across all GeForce product lines affected by this limitation. The company's professional-grade Turing and Ampere cards never received this restriction. Removing the artificial ceiling restores full matrix-math performance to these consumer devices, potentially accelerating both prompt evaluation and generative image workloads.

Source: Tom's Hardware · Reporting supplemented by The Silicon Ledger staff.