What’s one of the biggest things slowing an AI chip down?
-
Doing the calculations
109 votes (26.8%)
-
Waiting for data from memory
175 votes (43.0%)
-
Cooling the processor
65 votes (16.0%)
-
Connecting to the internet
58 votes (14.3%)
Total votes: 407
Answer: Waiting for data from memory
You might assume an AI chip spends most of its time crunching numbers. But often the bottleneck is simply getting the data to the processor fast enough.
That’s what makes Cerebras’s approach so interesting. Instead of cutting a silicon wafer into hundreds of separate chips and moving data between processors and memory, it uses the wafer as one enormous processor with memory sitting right on the silicon. Less time moving data means less time waiting – and potentially much faster AI.