Mark Zuckerberg’s company, however, is also looking to reduce its dependence on Nvidia by switching to its in-house-designed chips later this year. The MTIA chips are aimed at data centers. Meta is keen to break into the largely monopolistic market of AI-powered chips currently held by Nvidia.

How powerful are MTIA v2 chips?

The next-gen MTIA chips use the 5nm architecture and consist of an 8×8 grid of processing elements (PEs), a 3.5x improvement over v1. Meta has tripled the size of the local PE storage and doubled the size of the on-chip SRAM to 256 MB while increasing its bandwidth by 3.5x, a press release said.

Meta is also working on supporting infrastructure for the chips and has developed a hardware rack that can hold 72 accelerators. The rack has three chassis with 12 boards that can house two accelerators each. The chips can clock 1.35 GHz, compared to the 800 MHz of their predecessor, and run at 90 watts.

The design is intended to provide more computing power, bandwidth, and memory capacity to the chips. Initially, Meta aimed to perform inference functions such as ranking and generating responses to user prompts. Meta plans to use the chips for more intense operations, such as training AI models using large data sets.

A shift to its chips could help Meta save millions in energy costs every year, alongside the billions needed in capital expenditure to buy chips from Nvidia.

Breaking Nvidia’s monopoly

Meta isn’t the only tech company looking to design and build its own AI chips. Legacy chipmaker Intel, which has lagged in catering to industry requirements for AI chips, also announced its new Gaudi chips at an event on Tuesday.

Intel claims its dedicated AI chip can train AI models three times faster than Nvidia’s H100 processors and generate responses faster than its Nvidia counterpart. The company’s latest chip, Gaudi 3, also uses the 5nm architecture and consists of two main processors fused together to deliver performance twice the speed of its predecessor.

Google’s Tensor Processing Units (TPUs) are the only significant competition to Nvidia’s processor. However, Google does not sell its processors. Instead, it allows developers access through its cloud platform.

The search engine giant recently announced that a new Arm-based central processing unit (CPU) dubbed Axion will also be available on its cloud platform. Google claims that the processing power of the CPU is 50 percent better than the x86 chips and 30 percent better than general Arm chips.