Archive for the ‘Alphago’ Category

Terence Tao Leads White House’s Generative AI Working Group … – Pandaily

On May 13th, Terence Tao, an award winning Australia-born Chinese mathematician, announced that he and physicist Laura Greene will co-chair a working group studying the impacts of generative artificial intelligence technology on the Presidential Council of Advisors on Science and Technology (PCAST). The group will hold a public meeting during the PCAST conference on May 19th, where Demis Hassabis, founder of DeepMind and creator of AlphaGo, as well as Stanford University professor Fei-Fei Li among others will give speeches.

According to Terence Taos blog, the group mainly researches the impact of generative AI technology in scientific and social fields, including large-scale language models based on text such as ChatGPT, image generators like DALL-E 2 and Midjourney, as well as scientific application models for protein design or weather forecasting. It is worth mentioning that Lisa Su, CEO of AMD, and Phil Venables, Chief Information Security Officer of Google Cloud are also members of this working group.

According to an article posted on the official website of the White House, PCAST develops evidence-based recommendations for the President on matters involving science, technology, and innovation policy, as well as on matters involving scientific and technological information that is needed to inform policy affecting the economy, worker empowerment, education, energy, the environment, public health, national and homeland security, racial equity, and other topics.

SEE ALSO: Mathematician Terence Tao Comments on ChatGPT

After the emergence of ChatGPT, top mathematicians like Terence Tao also paid great attention to it and began exploring how artificial intelligence could help them complete their work. In an article titled How will AI change mathematics? Rise of chatbots highlights discussion in the Nature Journal, Andrew Granville, a number theorist at McGill University in Canada, also said that we are studying a very specific question: will machines change mathematics? Mathematician Kevin Buzzard agrees, saying that in fact, now even Fields Medal winners and other very famous mathematicians are interested in this field, which shows that it has become popular in an unprecedented way.

Previously, Terence Tao wrote on the decentralized social network Mastodon, Today was the first day that I could definitively say that #GPT4 has saved me a significant amount of tedious work. In his experimentation, Terence Tao discovered many hidden features of ChatGPT such as searching for formulas, parsing documents with code formatting, rewriting sentences in academic papers and sometimes even semantically searching incomplete math problems to generate hints.

See the original post here:
Terence Tao Leads White House's Generative AI Working Group ... - Pandaily

Why we should be concerned about advanced AI – Epigram

By Gaurav Yadav, Second year, Law

In 1955, four scientists coined the term artificial intelligence (AI) and embarked on a summer research project aimed at developing machines capable of using language, forming abstractions and solving problems typically reserved for humans. Their ultimate goal was to create machines rivalling human intelligence. The past decade has witnessed a remarkable transformation in AI capabilities, but this rapid progress should prompt more caution than enthusiasm.

The foundation of AI lies in machine learning, a process by which machines learn from data without explicit programming. Using vast datasets and statistical methods, algorithms identify patterns and relationships in the data, later using these patterns to make predictions or decisions on previously unseen data. The current paradigm in machine learning involves developing artificial neural networks that mimic the human brain's structure.

AI systems can be divided into two categories: 'narrow' and 'general'. A 'narrow' AI system excels in specific tasks, such as image recognition or strategic games like chess or Go, whereas artificial general intelligence (AGI) refers to a system proficient across a wide range of tasks, comparable to a human being.

A growing number of people worry that the emergence of advanced AI could lead to an existential crisis. Advanced AI broadly means AI systems capable of performing all cognitive tasks typically completed by humansenvision an AI system managing a company's operations as its CEO.

Daniel Eth, a former research scholar at the Future of Humanity Institute, University of Oxford, describes the potential outcome for advanced AI as one that could involve a single AGI surpassing human experts in most fields and disciplines. Another possibility entails an ecosystem of specialised AI systems, collectively capable of virtually all cognitive tasks. While researchers may disagree on the necessity of AGI or whether current AI models are approaching advanced capabilities, a general consensus exists that advanced or transformative AI systems are theoretically feasible.

Though certain aspects of this discussion might evoke a science fiction feel, recent AI breakthroughs seem to have blurred the line between fantasy and reality. Notable examples include large language models like GPT-4 and AlphaGo's landmark victory over Lee Sedol. These advancements underscore the potential for transformative AI systems in the future. AI systems can now recognise images, produce videos, excel at StarCraft, and produce text that is indistinguishable from human writing. The state of the art in AI is now a moving target, with AI capabilities advancing year after year.

Why should we be concerned about advanced AI?

If advanced AI is unaligned with human goals, it could pose significant risks for humanity. The 'alignment problem'which is the problem of aligning the goals of an AI with human objectivesis difficult because of the black-box nature of neural networks. It is incredibly hard to know what is going on inside of an AI when its coming up with outputs. AI systems might develop their own goals that diverge from ours, which are challenging to detect and counteract.

For instance, a reinforcement learning model (another form of machine learning), controlling a boat in a racing game maximised its score by circling and collecting power-ups rather than finishing the race. Given its aim was to achieve the highest score possible, it will go about finding ways to do that even if it breaks our understanding of how to play the game.

It may seem far-fetched to argue that advanced AI systems could pose an existential risk to humanity based on this humorous example. However, if we entertain the idea that AI systems can develop goals misaligned with our intentions, it becomes easier to envision a scenario where an advanced AI system could lead to disastrous consequences for mankind.

Imagine a world where advanced AI systems gain prominence within our economic and political systems, taking control of or being granted authority over companies and institutions. As these systems accumulate power, they may eventually surpass human control, leaving us vulnerable to permanent disempowerment.

What do we do about this?

There is a growing field of professionals that are working in the field of AI safety, who are focused on solving the alignment problem and ensuring that advanced AI systems do not spiral out of control.

Presently, their efforts encompass various approaches, such as interpretability work, which aims to decipher the inner workings of otherwise opaque AI systems. Another approach involves ensuring that AI systems are truthful with us. A specific branch of this work, known as eliciting latent knowledge, explores the extraction of "knowledge" from AI systems, effectively compelling them to be honest.

At the same time, significant work is being carried out in the realm of AI governance. This includes efforts to minimise the risks associated with advanced AI systems by focusing on policy development and fostering institutional change. Organisations such as the Centre for Governance of AI are actively engaged in projects addressing various aspects of AI governance. By promoting responsible AI research and implementation, these initiatives seek to ensure that advanced AI systems are developed and deployed in ways that align with human values and societal interests.

The field of AI safety remains alarmingly underfunded and understaffed, despite the potential risks of advanced AI systems. Benjamin Hilton estimates that merely 400 people globally are actively working to reduce the likelihood of AI-related existential catastrophes. This figure is strikingly low compared to the vast number of individuals working to advance AI capabilities, which Hilton suggests is approximately 1,000 times greater.

If this has piqued your interest or concern, you might want to consider pursuing a career in AI safety. To explore further, you could read the advice provided by 80,000 Hours, a website that provides support to help students and graduates switch into careers that tackle the worlds most pressing problems, or deepen your understanding of the field of AI safety by enrolling in the AGI Safety Fundamentals Course.

Featured image: Generated using DALL-E by OpenAI

Go here to see the original:
Why we should be concerned about advanced AI - Epigram

Purdue President Chiang to grads: Let Boilermakers lead in … – Purdue University

Purdue President Mung Chiang made these remarks during the universitys Spring Commencement ceremonies May 12-14.

Opening

Today is not just any graduation but the commencement at a special place called Purdue, with a history that is rich and distinct and an accelerating momentum of excellence at scale. There is nothing more exciting than to see thousands of Boilermakers celebrate a milestone in your lives with those who have supported you. And this commencement has a special meaning to me as my first in the new role serving our university.

President Emeritus Mitch Daniels gave 10 commencement speeches, each an original treatise, throughout the Daniels Decade. I was tempted to simply ask generative AI engines to write this one for me. But I thought itd be more fun to say a few thematic words by a human for fellow humans before that becomes unfashionable.

AI at Purdue

Sometime back in the mid-20th century, AI was a hot topic for a while. Now it is again; so hot that no computation is too basic to self-anoint as AI and no challenge seems too grand to be out of its reach. But the more you know how tools such as machine learning work, the less mysterious they become.

For the moment, lets assume that AI will finally be transformational to every industry and to everyone: changing how we live, shaping what we believe in, displacing jobs. And disrupting education.

Well, after IBMs Deep Blue beat the world champion, we still play chess. After calculators, children are still taught how to add numbers. Human beings learn and do things not just as survival skills, but also for fun, or as a training of our mind.

That doesnt mean we dont adapt. Once calculators became prevalent, elementary schools pivoted to translating real-world problems into math formulations rather than training for the speed of adding numbers. Once online search became widely available, colleges taught students how to properly cite online sources.

Some have explored banning AI in education. That would be hard to enforce; its also unhealthy as students need to function in an AI-infused workplace upon graduation. We would rather Purdue evolve teaching AI and teaching with AI.

Thats why Purdue offers multiple major and minor degrees, fellowships and scholarships in AI and in its applications. Some will be offered as affordable online credentials, so please consider coming back to get another Purdue degree and enjoy more final exams!

And thats why Purdue will explore the best way to use AI in serving our students: to streamline processes and enhance efficiency so that individualized experiences can be offered at scale in West Lafayette. Machines free up human time so that we can do less and watch Netflix on a couch, or we can do more and create more with the time saved.

Pausing AI research is even less practical, not the least because AI is not a well-defined, clearly demarcated area in isolation. All universities and companies around the world would have to stop any research that involves math. My Ph.D. co-advisor, Professor Tom Cover, did groundbreaking work in the 1960s on neural networks and statistics, not realizing those would later become useful in what others call AI. We would rather Purdue advance AI research with nuanced appreciation of the pitfalls, limitations and unintended consequences in its deployment.

Thats why Purdue just launched the universitywide Institute of Physical AI. Our faculty are the leaders at the intersection of virtual and physical, where the bytes of AI meet the atoms of what we grow, make and move from agriculture tech to personalized health care. Some of Purdues experts develop AI to check and contain AI through privacy-preserving cybersecurity and fake video detection.

Limitations and Limits

As it stands today, AI is good at following rules, not breaking rules; reinforcing patterns, not creating patterns; mimicking whats given, not imagining beyond their combinations. Even individualization algorithms, ironically, work by first grouping many individuals into a small number of similarity classes.

At least for now, the more we advance artificial intelligence, the more we marvel at human intelligence. Deep Blue vs. Kasparov, or AlphaGo vs. Lee, were not fair comparisons: the machines used four orders of magnitude more energy per second! Both the biological mechanisms that generate energy from food and the amount of work we do per Joule must be astounding to machines envy. Can AI be as energy efficient as it is fast? Can it take in energy sources other than electricity? When someday it does, and when combined with sensors and robotics that touch the physical world, youd have to wonder about the fundamental differences between humans and machines.

Can AI, one day, make AI? And stop AI?

Can AI laugh, cry and dream? Can it contain multitudes and contradictions like Walt Whitman?

Will AI be aware of itself, and will it have a soul, however awareness and souls are defined? Will it also be T.S. Eliots infinitely suffering things?

Where does an AI life start and stop anyway? What constitutes the identity of one AI, and how can it live without having to die? Indeed, if the memory and logic chips sustain and merge, is AI all collectively one life? And if AI duplicates a humans mind and memory, is that human life going to stay on forever, too?

These questions will stay hypothetical until breakthroughs more architectural than just compounding silicon chips speed and exploding data to black-box algorithms.

However, if given sufficient time and as a matter of time, some of these questions are bound to eventually become real, what then is uniquely human? What would still be artificial about artificial intelligence? Some of that eventuality might, with bumps and twists, show up faster than we had thought. Perhaps in your generation!

Freedoms and Rights

If Boilermakers must face these questions, perhaps it does less harm to consider off switches controlled by individual citizens than a ban by some bureaucracy. May the medicine be no worse than the disease, and regulations by government agencies not be granular or static, for governments dont have a track record of understanding fast-changing technologies, let alone micromanaging them. Some might even argue that government access to data and arbitration of algorithms counts among the most worrisome uses of AI.

What we need are basic guardrails of accountability, in data usage compensation, intellectual property rights and legal liability.

We need skepticism in scrutinizing the dependence of AI engines output on their input. Data tends to feed on itself, and machines often give humans what we want to see.

We need to preserve dissent even when its inconvenient, and avoid philosopher kings dressed in AI even when the alternative appears inefficient.

We need entrepreneurs in free markets to invent competing AI systems and independently maximize choices outside the big tech oligopoly. Some of them will invent ways to break big data.

Where, when and how is data collected, stored and used? Like many technologies, AI is born neutral but suffers the natural tendency of being abused, especially in the name of the collective good. Todays most urgent and gravest nightmare of AI is its abuse by authoritarian regimes to irreversibly lock in the Orwellian 1984: the surveillance state oppressing rights, aided and abetted by AI three-quarters of a century after that bleak prophecy.

We need verifiable principles of individual rights, reflecting the Constitution of our country, in the age of data and machines around the globe. For example, MOTA:

My worst fear about AI is that it shrinks individual freedom. Our best hope for AI is that it advances individual freedom. That it presents more options, not more homogeneity. That the freedom to choose and free will still prevail.

Let us preserve the rights that survived other alarming headlines in centuries past.

Let our students sharpen the ability to doubt, debate and dissent.

Let a university, like Purdue, present the vista of intellectual conflicts and the toil of critical thinking.

Closing

Now, about asking AI engines to write this speech. We did ask it to write a commencement speech for the president of Purdue University on the topic of AI, after I finished drafting my own.

Im probably not intelligent enough or didnt trust the circular clichs on the web, but what I wrote had almost no overlap with what AI did. I might be biased, but the AI version reads like a B- high school essay, a grammatically correct synthesis with little specificity, originality or humor. Its so toxically generic that even adding a human in the loop to build on it proved futile. Its so boring that you would have fallen asleep even faster than you just did. By the way, you can wake up now: Im wrapping up at last.

Maybe most commencement speeches and strategic plans sound about the same: Universities have made it too easy for language models! Maybe AI can remind us to try and be a little less boring in what we say and how we think. Maybe bots can murmur: Dont you ChatGPT me whenever were just echoing in an ever smaller and louder echo chamber down to the templated syntax and tired words. Smarter AI might lead to more interesting humans.

Well, there were a few words of overlap between my draft and AIs. So, heres from both some bytes living in a chip and a human Boilermaker to you all on this 2023 Purdue Spring Commencement: Congratulations, and Boiler Up!

Read this article:
Purdue President Chiang to grads: Let Boilermakers lead in ... - Purdue University

12 shots at staying ahead of AI in the workplace – pharmaphorum

Oliver Stohlmanns Corporate Survival Hacks series draws on his experiences of working in local, regional, and global life sciences communications to offer some little tips for enjoying a big business career. In this update, he shares expectations on how artificial intelligence (AI) may impact our workplaces and what we may do to leverage this trend for the benefit of both people and business.

Regardless of where you are on the corporate ladder, whether you know it or not, your life is going to change; dramatically, fast.

Indications of what artificial intelligence (AI) is already able to do and how its broader application will change our work environment are mind-boggling. What well experience in the next five to ten years is a massive explosion of AI usage in nearly all areas of life.

The beginning of the beginning?

A few examples? Generating flawless text or images is no longer an issue of skill or knowledge. Most AI-generated results are so impressive that a number of people and professions are already impacted by this.

As a teacher or university lecturer, it hardly makes sense today to have students draft their own essays or academic papers. According to Nature, it has become impossible even for scientists to differentiate with certainty between AI-created and original abstracts.

At a recent marketing seminar I was involved in, not one of 36 business students was able to provide a superior and better structured answer than ChatGPT to the question, Please explain SWOT analysis. Try for yourself.

Authentic voice and imagery

In the US, the start-up DoNotPay was about to run a pilot in February in which AI would represent a client in a speeding case court hearing. The chatbot would run on a smartphone, listening to what was being said in court, before whispering instructions into the defendants earpiece on how to best answer the judges questions. The experiment got stopped at the last minute by state bar associations concerned about the robot lawyer practicing law without a license. However, if these objections can be resolved, this may be the way forward in many comparable settings. Its not a matter of AI capability.

If you cannot or do not wish to attend meetings in person, VALL-E is able to read any text in your voice and tonality, or anyone elses. All you need to do is submit a three-second original voice sample. Soon the human ear will not be able to differentiate between the authentic sound of a persons voice and AI imitations of it.

DALL-E2 is an AI system that can create realistic images and artwork in line with your exact specifications, from your description in natural language. The need for graphic designers, photographers, illustrators, and even classic painters will fade.

Shifting from the what to the how

In the future, the best speakers will be those able to authentically repeat what those little ear pods tell them with exceptional charisma, intonation, natural gestures, and facial expressions. Neither content nor expertise will be a bottleneck. An AI-enabled speaker will be able to talk about absolutely any subject on any level of expertise. And yes, theyll be able to answer any question, too, even the provocative ones.

The best business consultants, trainers, and leadership coaches will be those with outstanding social, didactic, and motivational skills. Professional education will continue to matter, but it will focus much more on supporting executives on how to run their business, team, and customer relations; not on transferring knowledge. Being an expert knowledgeable on the what will not suffice. Most consultants, trainers, and coaches will be replaced by social learning environments. Facilitators may guide customised knowledge acquisition, while coaches and consultants will largely focus on optimising executives acumen, personality, and other soft components of effective leadership.

More human in Human Resources

The best people managers will be those who naturally adopt and apply the latest intelligence on people management that their employers AI-powered HR function equips them with. Human touch will not be lacking. Itll be delivered in a personalised way allowing the manager to tailor their approach to different team members of diverse engagement drivers and needs. Data collection and evaluation will run fully automated in the background, providing the manager with individual strength assessments, goal recommendations, performance tracking, corrective interventions, and development recommendations customised to each team member while calibrating across large organisations in real time.

The best HR representatives will be those who lend these automated processes and decisions a trustworthy, fair, and human face. Decisions will be facilitated and employee conversations prepared flawlessly by AI systems running in the background. The number of real people employed in human resources will shrink. Those left, however, will primarily focus on interfacing with internal clients and employees. The quality of these interactions, and that of preparing materials and compelling scripts to enable powerful conversations, will materially increase.

Language creation and translation

The best writers will be Whoops, I started this sentence wrong: therell be no need for writers. Or very few, outstanding ones at best. Already today, AI-generated texts are of a quality, clarity, and artistic beauty that beats 80% of human professional writers. Try it out: ask ChatGPT to draft an introduction for the website of company Human Hips that designs and replaces human hip implants. See what happens.

I just made up that company name. If it existed, they may use the resulting draft for their website straight. Yes, it could be improved by a great writer, more details added reflecting the specialty offerings of that enterprise. However, AI is on track to producing superior texts compared to most human writers, based on minimal input and cost, and faster than anyone else could.

The best translators will be Sorry, got this wrong again: translators will disappear. AI already supplies great, and will deliver perfect, translations into any and all global languages in split seconds, for any length and complexity of written or spoken word. Roles that translate texts or simultaneously translate the spoken word will be a concept of the past.

Seizing the AI revolution

The best employees those who retain well-paid jobs and climb the career ladder will be those able to competently navigate the avalanche of AI-led and augmented applications. They can select the relevant ones to add business value and adapt key features to meet specific business and customer needs. Theyre able to utilise AI to achieve outcomes faster and more efficiently, at lower cost and better quality than whats imaginable today.

The best executives will be algorithm-based. Of course, its a scary prospect to remove thinking humans with deep background and long experience from the positions of power. However, just imagine how much better, faster, fairer, and more ethical fact-based decision-making could become once typical human flaws are removed from the equation. These may include ones individual values and beliefs, ideologies, biases, personal relationships, and interdependencies, including corruption and other temptations; plus cultural and institutional norms, value-systems, expectations, and the pressures typically resulting from those. Scary, but likely in the future.

The best politicians will be You get my drift!

But theres an upside - many, actually

I would be mistaken if I didnt at least briefly point out the phenomenally positive, life-enhancing, and sometimes life-saving opportunities AI brings to society, too.

Apart from GPS systems navigating us to destinations safely, faster, and more reliably, our cars are already equipped with lots of other AI-based safety features that serve to prevent accidents before they happen. An armada of sensors connected and communicating with smart control centres is constantly watching not only over the cars we use, but buses, trains, ships, planes, trucks, agricultural machinery, etc., to keep operations, passengers, and freight safe. They also make sure that buildings, roads, rail tracks, bridges, tunnels, airports, harbours, stations, wind turbines, and all other infrastructure is constantly monitored and gets maintained preventatively before fatigue, vibrations, climate, or other forces can lead to damage or disaster.

As much as I dont like the idea of machines taking over, they most certainly make safer drivers than I am. My future driverless car wont get distracted, nor will it become tired, and it will be able to detect nearing obstacles, stopping traffic, or the deer about to cross the road earlier than I could. In the same way, pilots have been using autopilots for years that cannot only keep planes stable in the air, but also take off and land them safely in the harshest weather conditions.

Human health: an AI beneficiary

In medicine, AI-augmented surgery can already operate more precisely than the human hand could, with trained physicians informing and supervising the process and intervening as needed. Implants are being precision-measured, designed to your individual specifications, and a unique product tailormade to provide an optimal, long-lasting fit. Thats not to mention the fast, minimally invasive precision-surgery that spares patients pain and time, while reducing hospital capacity and cost.

Innovative medical therapies will be designed, developed, and clinically trialled much faster driven by AI-led processes, and made available to the right patients, who benefit from treatment and who will have been pre-determined with the aid of biomarkers or other tests conducted by means of you guessed it AI at rocket speed and precision.

These are just examples. The fast-increasing use of AI will radically change the way we work and live. But it will also usher in a world of opportunities that we and future generations will greatly benefit from.

Buckle up!

However, in case you find the above scenarios unsettling: most do not even touch on the true potential of artificial intelligence. What weve been talking about, so far, is mostly the seamless automation of individual steps and processes so that results can be achieved faster, more efficiently, and more accurately than any human brain could.

Fasten your seatbelts for when true self-learning algorithms with the capacity and capability to continuously learn from errors and instantly apply their insights to improve approaches in real-time are ready for mass application.

For instance, DeepMinds AlphaGo system, who apologies: that famously defeated the worlds Go champion Le Se-dol in 2016. Three years later, the South Korean attributed his retirement from the complex board game to the rise of AI, saying that it was an entity that cannot be defeated.

Well, for a bit of hope, read this recent update on how the story continued with a comprehensive defeat of a top-ranked AI system in the same game. However, you may also notice even that human victory over AI was owed to yet more artificial intelligence support

Whichever way you look at the rise of AI, its diverse applications, future possibilities, or the potential need for regulation: its going to be a fast ride.

About the author

Oliver Stohlmann is a communications leader with more than 20 years experience of working at local, regional, and global levels for several of the worlds premier life sciences corporations. Most recently, he was Johnson & Johnsons global head of external innovation communication. He currently works for Exscientia plc and as an independent leadership coach, trainer, team-developer, and communications consultant.

Read the rest here:
12 shots at staying ahead of AI in the workplace - pharmaphorum

Hypotheses and Visions for an Intelligent World – Huawei

As we move towards an intelligent world, information sensing, connectivity, and computing are becoming key. The better knowledge and control of matter, phenomena, life, and energy that result from these technologies are also becoming increasingly important. This makes rethinking approaches to networks and computing critical in the coming years.

In terms of networks, about 75 years ago Claude Shannon proposed his theorems based on three hypotheses: discrete memoryless sources, classical electromagnetic fields, and simple propagation environments. But since then, the industry has continued to push the boundaries of his work.

In 1987, Jim Durnin discovered self-healing non-diffracting beams that could continue to propagate when encountering an obstruction.

In 1992, L. Allen et. al. postulated that the spin and orbital angular momentum of an electromagnetic field has infinite orthogonal quantum states along the same propagation direction, and each quantum state can have one Shannon capacity.

After AlphaGo emerged in 2016, people realized how well foundation models can be used to describe a world with prior knowledge. This means that much information is not discrete or memoryless.

With the large-scale deployment of 5G Massive MIMO in 2018, it has become possible to have multiple independent propagation channels in complex urban environments with tall buildings, boosting communications capacity.

These new phenomena, knowledge, and environments are helping us break away from the hypotheses that shaped Shannon theorems. With them, I believe we can achieve more than 100-fold improvement in network capabilities in the next decade.

In computing, intelligent applications are developing rapidly, and AI models in particular are likely to help solve the fragmentation problems that are currently holding AI application development back. This is driving an exponential growth in model size. Academia and industry have already begun exploring the use of AI in domains like software programming, scientific research, theorem verification, and theorem proving. With more powerful computing models, more abundant computing power, and higher-quality data, AI will be able to better serve social progress.

AI capabilities are improving rapidly, and so we need to consider how to ensure AI development progresses in a way that benefits all people and ensures that AI execution is accurate and efficient. In addition to ethics and governance, AI also faces three big challenges from a theoretical and technical perspective: AI goal definition, accuracy and adaptability, and efficiency.

The first challenge AI faces is that there is no agreed upon definition of its goals. What kind of intelligence do we need?

If there is no clear definition, it is difficult to ensure that the goals of AI and humanity will be aligned and to make reasonable measurements and classifications and scientific computations. Professor Adrian Bejan, a physicist at Duke University, summarizes more than 20 goals for intelligence in his book The Physics of Life, including understanding and cognitive ability, learning and adaptability, and abstract thinking and problem-solving ability. There are many schools of AI, which are poorly integrated. One important reason for this is there are no commonly agreed upon goals for AI.

The second challenge AI faces is accuracy and adaptability. Learning based on statistical rules extracted from big data often results in non-transparent processes, unstable results, and bias. For example, when recognizing a banana using statistical and correlation-based algorithms, an AI system can be easily affected by background combinations and tiny noises. If other pictures are put next to it, the banana may be recognized as an oven or a slug. These pictures can be easily recognized by people, but AI makes these mistakes and it is difficult to explain or debug them.

The third challenge for AI is efficiency. According to the 60th TOP500 published in 2022, the fastest supercomputer is Frontier, which can achieve 1,102 PFLOPS while using 21 million watts of energy. Human brains, in contrast, can deliver about 30 PFLOPS with just 20 watts. These numbers show that the human brain is about 30,000 to 100,000 times more energy efficient than a supercomputer.

In addition to energy efficiency, data efficiency is also a major challenge for AI. It is true that we can better understand the world by extracting statistical laws from big data. But can we find logic and generate concepts from small data, and abstract them into principles and rules?

We have come up with several hypotheses to address these three challenges:

Starting from these hypotheses, we can begin to take more practical steps to develop knowledge and intelligence.

At Huawei, our first vision is to combine systems engineering with AI to develop accurate, autonomous, and intelligent systems. In recent years, there has been a lot of research in academia about new AI architectures that go beyond transformers.

We can build upon these thoughts by focusing on three parts: perception and modeling, automatic knowledge generation, and solutions and actions. From there, we can develop more accurate, autonomous, and intelligent systems through multimodal perception fusion and modeling, as well as knowledge and data-driven decision-making.

Perception and modeling are about representations and abstractions of the external environment and ourselves. Automatic knowledge generation means systems will need to integrate the existing experience of humans into strategy models and evaluation functions to increase accuracy. Solutions can be directly deduced based on existing knowledge as well as internal and external information, or through trial-and-error and induction. We hope that these technologies will be incorporated into future autonomous systems, so that they can better support domains like autonomous driving networks, autonomous vehicles, and cloud services.

Our second vision is to create better computing models, architectures, and components to continuously improve the efficiency of intelligent computing. I once spoke with Fields Medalist Professor Laurent Lafforgue about whether invariant object recognition could be made more accurate and efficient by using geometric manifolds for object representation and computing in addition to pixels, which are now commonly used in visual and spatial computing.

In their book Neuronal Dynamics, co-authors Gerstner, Kistler, Naud, and Paninski at cole Polytechnique Fdrale de Lausanne (EPFL) explain the concept of functional columns in the cerebral cortex and the six-layer connections between these functional columns. It makes me wonder: Can such a shallow neural network be more efficient than a deep neural network?

A common bottleneck for today's AI computing is the memory wall. Reading, writing, and migrating data often takes 100-times more time than computing itself. So, can we possibly bypass conventional processors, instruction sets, buses, logic components, and memory components under von Neumann architecture, and redefine architectures and components based on advanced AI computing models instead?

Huawei has been exploring this idea by looking into the practical uses of AI. First, we have worked on "AI for Industry", which uses industry-specific large models to create more value. Industries face many challenges when it comes to AI application development. They need to invest a huge amount of manpower to label samples, find it difficult to maintain models, and lack the necessary capabilities in model generalization. Most simply they do not have the resources to do this.

To address these challenges, Huawei has developed L1 industry-specific large models based on its L0 large foundation models dedicated to computer vision, natural language processing, graph neural networks, and multi-modal interactions. These large models lower the barrier to AI development, improve model generalization, and address application fragmentation. The models are already being used to improve operational efficiency and safety in major industries like electric power, coal mining, transportation, and manufacturing.

Huawei's Aviation & Rail Business Unit, for example, is working with customers and partners in Hohhot, Wuhan, Xi'an, Shenzhen, and Hongkong to explore the digital transformation of urban rail, railways, and airports. This has improved operational safety and efficiency, as well as user experience and satisfaction. The Shenzhen Airport has realized smart stand allocation with the support of cloud, big data, and AI, reducing airside transfer bus passenger flow by 2.6 million every year. The airport has become a global benchmark in digital transformation.

"AI for Science" is another initiative that will be able to greatly empower scientific computing. One example of this in action is the Pangu meteorology model we developed using a new 3D transformer-based coding architecture for geographic information and a hierarchical time-domain aggregation method. With a prior knowledge of global meteorological phenomena, the Pangu model uses more accurate and efficient learning and reasoning to replace time series solutions of hyperscale partial differential equations using traditional scientific computing methods. The Pangu model can produce 1-hour to 7-day weather forecasts in just a few seconds, and its results are 20% more accurate than forecasts from the European Centre for Medium-Range Weather Forecasts.

AI can also support software programming. In addition to using AI to do traditional retrieval and recommendation in a large amount of existing code, Huawei is developing new model-driven and formal methods. This is especially important for large-scale parallel processing, where many tasks are intertwined and correlated. Huawei has developed a new approach called Vsync which realizes automatic verification and concurrent code optimization of operating system kernels, and improves performance without undermining reliability. The Linux Community once discovered a difficult memory barrier bug which took community experts more than two years to fix. With Huawei's Vsync method, however, it would have taken just 20 minutes to discover and fix the bug.

We have also been studying new computing models for automated theorem proving. Topos theory, for example, can be used to research category proving, congruence reasoning systems, and automated theorem derivation to improve the automation level of theorem provers. In doing this, we want to solve state explosion and automatic model abstraction problems and improve formal verification capabilities.

Finally, we are also exploring advanced computing components. We can use the remainder theorem to address conversion efficiency and overflow problems in real-world applications. We hope to implement basic addition and multiplication functions in chips and software to improve the efficiency of intelligent computing.

As we move towards the intelligent world, networks and computing are two key cornerstones that underpin our shift from narrow AI towards general-purpose AI and super AI. To get there, we will need to take three key steps. First, we will need to develop AI theories and technologies, as well as related ethics and governance, so that we can deliver ubiquitous intelligent connectivity and drive social progress. Second, we will need to continue pushing our cognitive limits to improve our ability to understand and control intelligence. Finally, we need to define the right goals and use the right approaches to guide AI development in a way that truly helps overcome human limitations, improve lives, create matter, control energy, and transcend time and space. This is how we will succeed in our adventure into the future.

The rest is here:
Hypotheses and Visions for an Intelligent World - Huawei