What Elon Musk and Ilya Sutskever Feared About OpenAI Is Becoming Reality – Observer

OpenAI CEO Sam Altman has previously discussed his desire to achieve human-level reasoning in A.I. Justin Sullivan/Getty Images

As part of OpenAIs path towards artificial general intelligence (A.G.I), a term for technology matching the intelligence of humans, the company is reportedly attempting to enable A.I. models to perform advanced reasoning. Such work is taking place under a secretive project code-named Strawberry, as reported by Reuters, which noted that the project was previously known as Q* or Q Star. While its name may have changed, the project isnt exactly new. Researchers and co-founders of OpenAI have previously warned against the initiative, with concerns over it reportedly playing a part in the brief ousting of Sam Altman as OpenAIs CEO in November.

Strawberry uses a unique method of post-training A.I. models, a process that improves their performance after being trained on datasets, according to Reuters, which cited internal OpenAI documents and a person familiar with the project. With the help of deep-research datasets, the company aims to create models that display human-level reasoning. OpenAI reportedly is looking into how Strawberry can allow models to be able to complete tasks over an extended period of time, search the web by themselves and take actions on its findings, and perform the work of engineers. OpenAI did not respond to requests for comment from Observer.

Altman, who has previously reiterated OpenAIs desire to create models able to reason, briefly lost control of his company last year when his board fired him for four days. Shortly before the ousting, several OpenAI employees had become concerned over breakthroughs presented by what was then known as Q*, a project spearheaded by Ilya Sutskever, OpenAIs former chief scientist.Sutskever himself had reportedly begun to worry about the projects technology, as did OpenAI employees working on A.I. safety at the time. After his reinstatement, Altman referred to news reports about Q* as an unfortunate leak in an interview with the Verge.

Elon Musk, another OpenAI co-founder, has also raised the alarm about Q* in the past. The billionaire, who severed ties with the company in 2018, referred to the project in a lawsuit filed against OpenAI and Altman that has since been dropped. While discussing OpenAIs close partnership with Microsoft (MSFT), Musks suit claimed that the terms of the deal dictate that Microsoft only has rights to OpenAIs pre-A.G.I. technology and that it is up to OpenAIs board to determine when the company has achieved A.G.I.

Musk argued that OpenAIs GPT-4 model constitutes as A.G.I, which he believes poses a grave threat to humanity, according to the suit. Court filings stated that OpenAI is currently developing a model known as Q* that has an even stronger claim to A.G.I.

Recent internal meetings have suggested that OpenAI is making rapid progress toward the type of human-level reasoning that Strawberry is working on. In an OpenAI all-hands meeting held earlier this month, the company unveiled a five-tiered system to track its progress towards A.G.I., as reported by Bloomberg. While the company said it is currently on the first level, known as chatbots, it revealed that it has nearly reached the second level of reasoners, which involves technology that can display human-level problem-solving. The subsequent steps consist of A.I. systems acting as agents that can take actions, innovators that aid in invention and organizations that do the work of an organization.

View post:

What Elon Musk and Ilya Sutskever Feared About OpenAI Is Becoming Reality - Observer

Related Posts

Comments are closed.