SpiNNaker, the Million-Core Supercomputer, Finally Switched On

After 12 years in the making, the “brain computer” designed at the University of Manchester is finally switched on. What does this computer do? How is it made? And who is Steve Furber?

AI systems have been rapidly developed in the past decade with the use of deep learning, neural networks, and large computers to try and simulate neurons. But AI is not the only area of interest when using such techniques; scientists and engineers alike are also keen to try and simulate the human brain to better understand how it works and why.

Simulating the brain is no trivial task. The complexity of the human brain is difficult to replicate, which is part of why the SpiNNaker computer is important.

 

The Challenges of Simulating a Brain

One of the first fundamental differences between the brain and computers is how their “smallest units” function. Brain neurons can have multiple connections and react to impulses in a range of different ways. Computer transistors, by comparison, are switches that, while can be connected to other transistors, can only have one of two states.

Neurons are also able to forge links between other neurons and react to stimuli differently (which is one definition of "learning"), whereas transistor connections are fixed.

Because of these differences, scientists have to “simulate” neurons and connections in software rather than in hardware, which severely impacts the number of neurons and links that can be simulated simultaneously.

What about simulation neurons in hardware?

Neurons and transistors share little in common but a better comparison would be simple microcontrollers and FPGAs; microcontrollers are akin to neurons in that they can process outside signals quickly while being comparatively simple in architecture while FPGAs provide the ability to break and create connections between microcontrollers.

Could hardware simulation be the key? One team of researchers believes so and has spent the last 12 years on the idea.

The SpiNNaker

A research team at the University of Manchester have spent the last 12 years creating a computer that will simulate neurons and connections with the use of many simple cores all interconnected on a massive parallel system and the computer, called SpiNNaker, was finally turned on.

The million-core computer is designed to simulate up to a billion neurons in real-time to allow scientists to study neural networks and pathways in a realistic manner by using hardware as opposed to software.

Unlike traditional methods for simulating neurons, SpiNNaker has individual processors that each simulate up to 1000 neurons that transmit and receive small packets of data to and from many other neurons simultaneously.  

 

Hexagonal topology between processors and a 48-processor SpiNNaker computer - Image courtesy University of Manchester

 

The Spiking Neural Network Architecture system (SpiNNaker) consists of 10 19-inch computer racks with each rack containing 100,000 ARM cores. This core density is achieved with the use of a custom IC that contain up to 18 cores. Each board in a rack has 48 chips, which results in each board containing 864 processors.

Unlike typical software systems, the cores are arranged in a hexagonal pattern with data transmission handled entirely in hardware. It is this topology that allows for the system to simulate one billion neurons in real-time. The system uses ARM9 processors containing a total of 7TB of RAM and 57K nodes while each processor has an off-die 128MB SDRAM and each core has 32KB ROM and 64KB data tightly-coupled memory DTCM.

 

SpiNNaker processor and half of the complete one million-core system. Image used courtesy of the University of Manchester

 

The SpiNNaker system is not just a single computer being held at a University for testing purposes; there are multiple SpiNNaker systems around the world!

Currently, there are up to 90 other machines being used in neural network applications but these systems are nowhere as large as the one-million-core machine house at the University of Manchester. Instead, these systems typically use a single SpiNNaker board containing 48 processors.

Today, SpiNNaker was finally turned on, putting all of this extraordinary research and planning into motion for the first time.

Who Is Steve Furber?

The project is led by Steve Furber, a Professor of Computer Engineering at the University of Manchester. His significance in the project is arguably more than just leading; Steve Furber is one of the original creators of the ARM processor!

 

Steve (right) examining the ARM processor. Image used courtesy of the University of Manchester

 

After completing his education at the University of Cambridge, Steve Furber joined with Hermann Hauser and Chris Curry to form Acorn Computers. As principal engineer at Acorn, it was his job to oversee and design one of the most influential computers in history: the BBC Micro.

While the BBC Micro was acceptable for school and home use, the business market was more demanding and Acorn had to plan a computer that could compete with the IBM series of machines. Research and development were performed for co-processors but it was determined that commercially available parts all performed relatively the same and were not suitable for graphics-related processes.

Therefore, Steve Furber and Sophie Wilson developed the ARM processor, which was designed to have simplified instruction architecture but be able to operate at higher speeds. Little did Acorn know that their creation of the ARM core would see their design in most microcontroller applications today.

Read More

• Historical Engineers: Michael Faraday, a Founding Father of Electrical Science
• Is AI Better at Diagnosing Disease than a Doctor?
• AI Predicted to Commit More Cyber Crime than People by 2040