VIDEO: Spider, Man: Scientists Use Night Vision And AI To Track Spiders’ Web-Building

AI study of how spiders build their intricate webs tracked millions of leg movements.

Researchers used night vision and artificial intelligence to discover how spiders build their often intricate webs to capture prey.

Johns Hopkins University scientists found that the eight-legged little creatures use their sense of touch to build elegant net-like structures of geometric precision that are delicate but strong. Spiders are among the few animals, along with weaver birds and puffer fish, capable of creating such architectural works.

“After seeing a spectacular web, I thought, ‘if you went to a zoo and saw a chimpanzee building this, you’d think that’s one amazing and impressive chimpanzee,’” said behavioral biologist Andrew Gordus. Noting that a spider’s brain is but a fraction of a human brain, he said it was frustrating that more is not known about them.

“Now we’ve defined the entire choreography for web building, which has never been done for any animal architecture at this fine of a resolution,” said Gordus, a co-author of a new study on the behavior available at Current Biology.

To understand how spider architects can build complex webs, Gordus and allied scientists documented and analyzed the various motor skills and behaviors involved. Because of the challenges in capturing and recording the behaviors, this had never been done before.

In the case of the hackled orb weaver, scientists designed a laboratory environment where infrared cameras and infrared light were used to monitor and record six spiders nightly. While the spiders worked on webs, the scientists tracked millions of their leg movements with machine vision software designed specifically to detect limb movement.

Johns Hopkins University researchers discovered that spiders behaved similarly while making webs, enabling them to predict which part of a web a spider was working on from seeing the position of a leg. (Johns Hopkins University)

“Even if you video record it, that’s a lot of legs to track, over a long time, across many individuals,” said study co-author Abel Corver. “It’s just too much to go through every frame and annotate the leg points by hand. So we trained machine vision software to detect the posture of the spider, frame by frame, so we could document everything the legs do to build an entire web.”

The researchers discovered that spiders behaved similarly while making webs, thus enabling them to predict which part of a web a spider was working on from seeing the position of a leg. “Even if the final structure is a little different, the rules they use to build the web are the same,” Gordus said.

 Johns Hopkins University researchers have detailed the entire choreography for spider web building, something that had never been done so precisely for any animal architecture. (Johns Hopkins University)

This confirmed for him that spiders’ web-making rules are encoded in their tiny brains. “Now we want to know how those rules are encoded at the level of neurons,” he said.

The next step will involve researchers watching how mind-altering drugs may affect spiders building their webs. “The spider is fascinating,” Corver said, “because here you have an animal with a brain built on the same fundamental building blocks as our own, and this work could give us hints on how we can understand larger brain systems, including humans.”

Edited by Richard Pretorius and Kristen Butler