Categories: ArticlesNewsYouTube

Scientists Teach Robots To “Watch” YouTube Videos And Learn From Them

People have talked about getting personal robots as assistants for years, but Cornell is doing more than just talking. The university’s “Robo Brain,” which launched online in July, teaches robots how to function in daily life from an extensive database of YouTube videos.

The Robo Brain database was created by Aditya Jami, a visiting researcher at Cornell. It essentially stores information in a robot-friendly format so the machines can pull from the cloud-like database whenever they need to perform a task like pouring a drink or finding keys.

“Our laptops and cell phones have access to all the information we want,” explained Ashutosh Saxena, an assistant professor of computer science, in the Cornell Chronicle. “If a robot encounters a situation it hasn’t seen before it can query Robo Brain in the cloud,”

Subscribe for daily Tubefilter Top Stories

Subscribe

Saxena led the information-gathering project, along with colleagues from Cornell, Stanford, Brown, and University of California, Berkeley. In July, according to The Washington Post, the team started downloading about 120,000 YouTube videos, over 100 million instruction manuals, billions of images, and more data for robots to reference.

Their work is paying off. So far, robots have learned when to hold a coffee cup upside-down  (i.e. how liquid interacts with the mugs), and how to scoop ice cream and drizzle syrup over the top. Additionally, robots have studied human interactions and learned when it’s appropriate not to intervene, like when two humans are talking. One robot even observed how a human became frustrated when the robot passed in front of the TV, so the next time it went behind the couch instead of in front of the human’s line of sight.

Check out the video below of the robot learning not to interrupt TV-watching. Down the line, you’ll also be able to visit the Robo Brain website if you’d like to be a “teacher,” leaving addictions or making corrections to the database information.

Share
Published by
Bree Brouwer

Recent Posts

With 500,000 sellers in the U.S. alone, TikTok touts the safety features of its Shop

Amidst a chaotic week at TikTok, the app took some time to acknowledge its growing community…

19 hours ago

Wesley Wang’s viral short film got 4.4 million views. A feature adaptation is in the works.

Nothing, Except Everything is getting a big-screen treatment. That's the name of a short film that…

20 hours ago

Creators on the Rise: Giulia Amato on faith, finding her niche, and getting up at 4 a.m.

Welcome to Creators on the Rise, where we find and profile breakout creators who are…

22 hours ago

Newsletter platform beehiiv prepares for expansion with $33 million Series B

A major player in the burgeoning newsletter industry has made a sizable addition to its…

2 days ago

Meta promotes original content on Instagram, launches bonus program on Threads

Meta has kicked off the week with a pair of announcements that should make its creator…

2 days ago

Top 5 Branded Videos of the Week: MrBeast’s latest sponsored smash is fun for all ages

MrBeast continues to show us that he's in a league of his own as far as…

3 days ago