Connect with us

Hi, what are you looking for?

American Stock ReviewAmerican Stock Review

Tech News

OpenAI cofounder Ilya Sutskever says the way AI is built is about to change

Ilya Sutskever. | Photo by JACK GUEZ/AFP via Getty Images

OpenAI’s cofounder and former chief scientist, Ilya Sutskever, made headlines earlier this year after he left to start his own AI lab called Safe Superintelligence Inc. He has avoided the limelight since his departure but made a rare public appearance in Vancouver on Friday at the Conference on Neural Information Processing Systems (NeurIPS).

“Pre-training as we know it will unquestionably end,” Sutskever said onstage. This refers to the first phase of AI model development, when a large language model learns patterns from vast amounts of unlabeled data — typically text from the internet, books, and other sources.

During his NeurIPS talk, Sutskever said that, while he believes existing data can still take AI development farther, the industry is tapping out on new data to train on. This dynamic will, he said, eventually force a shift away from the way models are trained today. He compared the situation to fossil fuels: just as oil is a finite resource, the internet contains a finite amount of human-generated content.

“We’ve achieved peak data and there’ll be no more,” according to Sutskever. “We have to deal with the data that…

Read the full story at The Verge.

You May Also Like

Tech News

This meat-handed mess was generated using DaVinci AI with the prompt “a photorealistic person looking at their phone with a disgusted expression.” | Image:...

Tech News

Sony’s “cosmic red” DualSense Wireless Controller is down to $54.99 ($20 off) for a limited time. | Photo by Cameron Faulkner / The Verge...

Tech News

Image: Netflix After years of brand tie-ins and ill-conceived spinoffs, the series is back — and it’s just as tense as ever. Read the...

Editor's Pick

Gold has been in the headlines over the last few months, perhaps more so now than in years. This heightened attention stems from shifts...