Viewing a single comment thread. View all comments

visarga t1_j36ccg4 wrote

Reply to comment by currentscurrents in [D] Special-purpose "neuromorphic" chips for AI - current state of the art? by currentscurrents

> Innatera claims 10000x lower power usage with their chip.

Unfortunately it's just a toy. Not gonna run GPT-3 on edge.

Googled for you: Innatera's third-generation AI chip has 256 neurons and 65,000 synapses and runs inference at under 1 milliwatt, which doesn't sound like a lot compared to the human brain, which has 86 billion neurons and operates at around 20 watts.

4

currentscurrents OP t1_j39hde8 wrote

Not bad for a milliwatt of power though - an arduino idles at about 15 milliwatts.

I could see running pattern recognition in a battery-powered sensor or something.

2