Archive for the ‘Alphago’ Category

Economic potential of generative AI – McKinsey

AI has permeated our lives incrementally, through everything from the tech powering our smartphones to autonomous-driving features on cars to the tools retailers use to surprise and delight consumers. As a result, its progress has been almost imperceptible. Clear milestones, such as when AlphaGo, an AI-based program developed by DeepMind, defeated a world champion Go player in 2016, were celebrated but then quickly faded from the publics consciousness.

Generative AI applications such as ChatGPT Copilot, Stable Diffusion, and others have captured the imagination of people around the world in a way AlphaGo did not, thanks to their broad utilityalmost anyone can use them to communicate and createand preternatural ability to have a conversation with a user. The latest generative AI applications can perform a range of routine tasks, such as the reorganization and classification of data. But it is their ability to write text, compose music, and create digital art that has garnered headlines and persuaded consumers and households to experiment on their own. As a result, a broader set of stakeholders are grappling with generative AIs impact on business and society but without much context to help them make sense of it.

The speed at which generative AI technology is developing isnt making this task any easier. ChatGPT was released in November 2022. Four months later, OpenAI released a new large language model, or LLM, called GPT-4 with markedly improved capabilities. Similarly, by May 2023, Anthropics generative AI, Claude, was able to process 100,000 tokens of text, equal to about 75,000 words in a minutethe length of the average novelcompared with roughly 9,000 tokens when it was introduced in March 2023. And in May 2023, Google announced several new features powered by generative AI, including Search Generative Experience and a new LLM called PaLM 2 that will power its Bard chatbot, among other Google products.

To grasp what lies ahead requires an understanding of the breakthroughs that have enabled the rise of generative AI, which were decades in the making. For the purposes of this report, we define generative AI as applications typically built using foundation models. These models contain expansive artificial neural networks inspired by the billions of neurons connected in the human brain. Foundation models are part of what is called deep learning, a term that alludes to the many deep layers within neural networks. Deep learning has powered many of the recent advances in AI, but the foundation models powering generative AI applications are a step-change evolution within deep learning. Unlike previous deep learning models, they can process extremely large and varied sets of unstructured data and perform more than one task.

Foundation models have enabled new capabilities and vastly improved existing ones across a broad range of modalities, including images, video, audio, and computer code. AI trained on these models can perform several functions; it can classify, edit, summarize, answer questions, and draft new content, among other tasks.

All of us are at the beginning of a journey to understand generative AIs power, reach, and capabilities. This research is the latest in our efforts to assess the impact of this new era of AI. It suggests that generative AI is poised to transform roles and boost performance across functions such as sales and marketing, customer operations, and software development. In the process, it could unlock trillions of dollars in value across sectors from banking to life sciences. The following sections share our initial findings.

For the full version of this report, download the PDF.

Generative AIs impact on productivity could add trillions of dollars in value to the global economy. Our latest research estimates that generative AI could add the equivalent of $2.6 trillion to $4.4 trillion annually across the 63 use cases we analyzedby comparison, the United Kingdoms entire GDP in 2021 was $3.1 trillion. This would increase the impact of all artificial intelligence by 15 to 40 percent. This estimate would roughly double if we include the impact of embedding generative AI into software that is currently used for other tasks beyond those use cases.

About 75 percent of the value that generative AI use cases could deliver falls across four areas: Customer operations, marketing and sales, software engineering, and R&D. Across 16 business functions, we examined 63 use cases in which the technology can address specific business challenges in ways that produce one or more measurable outcomes. Examples include generative AIs ability to support interactions with customers, generate creative content for marketing and sales, and draft computer code based on natural-language prompts, among many other tasks.

Generative AI will have a significant impact across all industry sectors. Banking, high tech, and life sciences are among the industries that could see the biggest impact as a percentage of their revenues from generative AI. Across the banking industry, for example, the technology could deliver value equal to an additional $200 billion to $340 billion annually if the use cases were fully implemented. In retail and consumer packaged goods, the potential impact is also significant at $400 billion to $660 billion a year.

Generative AI has the potential to change the anatomy of work, augmenting the capabilities of individual workers by automating some of their individual activities. Current generative AI and other technologies have the potential to automate work activities that absorb 60 to 70 percent of employees time today. In contrast, we previously estimated that technology has the potential to automate half of the time employees spend working. The acceleration in the potential for technical automation is largely due to generative AIs increased ability to understand natural language, which is required for work activities that account for 25 percent of total work time. Thus, generative AI has more impact on knowledge work associated with occupations that have higher wages and educational requirements than on other types of work.

The pace of workforce transformation is likely to accelerate, given increases in the potential for technical automation. Our updated adoption scenarios, including technology development, economic feasibility, and diffusion timelines, lead to estimates that half of todays work activities could be automated between 2030 and 2060, with a midpoint in 2045, or roughly a decade earlier than in our previous estimates.

Generative AI can substantially increase labor productivity across the economy, but that will require investments to support workers as they shift work activities or change jobs. Generative AI could enable labor productivity growth of 0.1 to 0.6 percent annually through 2040, depending on the rate of technology adoption and redeployment of worker time into other activities. Combining generative AI with all other technologies, work automation could add 0.2 to 3.3 percentage points annually to productivity growth. However, workers will need support in learning new skills, and some will change occupations. If worker transitions and other risks can be managed, generative AI could contribute substantively to economic growth and support a more sustainable, inclusive world.

The era of generative AI is just beginning. Excitement over this technology is palpable, and early pilots are compelling. But a full realization of the technologys benefits will take time, and leaders in business and society still have considerable challenges to address. These include managing the risks inherent in generative AI, determining what new skills and capabilities the workforce will need, and rethinking core business processes such as retraining and developing new skills.

Generative AI is a step change in the evolution of artificial intelligence. As companies rush to adapt and implement it, understanding the technologys potential to deliver value to the economy and society at large will help shape critical decisions. We have used two complementary lenses to determine where generative AI, with its current capabilities, could deliver the biggest value and how big that value could be (Exhibit 1).

The first lens scans use cases for generative AI that organizations could adopt. We define a use case as a targeted application of generative AI to a specific business challenge, resulting in one or more measurable outcomes. For example, a use case in marketing is the application of generative AI to generate creative content such as personalized emails, the measurable outcomes of which potentially include reductions in the cost of generating such content and increases in revenue from the enhanced effectiveness of higher-quality content at scale. We identified 63 generative AI use cases spanning 16 business functions that could deliver total value in the range of $2.6 trillion to $4.4 trillion in economic benefits annually when applied across industries.

That would add 15 to 40 percent to the $11 trillion to $17.7 trillion of economic value that we now estimate nongenerative artificial intelligence and analytics could unlock. (Our previous estimate from 2017 was that AI could deliver $9.5 trillion to $15.4 trillion in economic value.)

Our second lens complements the first by analyzing generative AIs potential impact on the work activities required in some 850 occupations. We modeled scenarios to estimate when generative AI could perform each of more than 2,100 detailed work activitiessuch as communicating with others about operational plans or activitiesthat make up those occupations across the world economy. This enables us to estimate how the current capabilities of generative AI could affect labor productivity across all work currently done by the global workforce.

Some of this impact will overlap with cost reductions in the use case analysis described above, which we assume are the result of improved labor productivity. Netting out this overlap, the additional economic benefits of generative AI beyond those use casesor the many small increases in productivity that are likely to materialize when the technology is applied to knowledge workers activitiesamounts to an additional $6.1 trillion to $7.9 trillion annually (Exhibit 2).

While generative AI is an exciting and rapidly advancing technology, the other applications of AI discussed in our previous report continue to account for the majority of the overall potential value of AI. Traditional advanced-analytics and machine learning algorithms are highly effective at performing numerical and optimization tasks such as predictive modeling, and they continue to find new applications in a wide range of industries. However, as generative AI continues to develop and mature, it has the potential to open wholly new frontiers in creativity and innovation. It has already expanded the possibilities of what AI overall can achieve (see sidebar How we estimated the value potential of generative AI use cases).

In this section, we highlight the value potential of generative AI across business functions.

Generative AI could have an impact on most business functions; however, a few stand out when measured by the technologys impact as a share of functional cost (Exhibit 3). Our analysis of 16 business functions identified just fourcustomer operations, marketing and sales, software engineering, and research and developmentthat could account for approximately 75 percent of the total annual value from generative AI use cases.

Notably, the potential value of using generative AI for several functions that were prominent in our previous sizing of AI use cases, including manufacturing and supply chain functions, is now much lower. This is largely explained by the nature of generative AI use cases, which exclude most of the numerical and optimization applications that were the main value drivers for previous applications of AI.

In addition to the potential value generative AI can deliver in function-specific use cases, the technology could drive value across an entire organization by revolutionizing internal knowledge management systems. Generative AIs impressive command of natural-language processing can help employees retrieve stored internal knowledge by formulating queries in the same way they might ask a human a question and engage in continuing dialogue. This could empower teams to quickly access relevant information, enabling them to rapidly make better-informed decisions and develop effective strategies.

In 2012, the McKinsey Global Institute (MGI) estimated that knowledge workers spent about a fifth of their time, or one day each work week, searching for and gathering information. If generative AI could take on such tasks, increasing the efficiency and effectiveness of the workers doing them, the benefits would be huge. Such virtual expertise could rapidly read vast libraries of corporate information stored in natural language and quickly scan source material in dialogue with a human who helps fine-tune and tailor its research, a more scalable solution than hiring a team of human experts for the task.

In other cases, generative AI can drive value by working in partnership with workers, augmenting their work in ways that accelerate their productivity. Its ability to rapidly digest mountains of data and draw conclusions from it enables the technology to offer insights and options that can dramatically enhance knowledge work. This can significantly speed up the process of developing a product and allow employees to devote more time to higher-impact tasks.

Following are four examples of how generative AI could produce operational benefits in a handful of use cases across the business functions that could deliver a majority of the potential value we identified in our analysis of 63 generative AI use cases. In the first two examples, it serves as a virtual expert, while in the following two, it lends a hand as a virtual collaborator.

Across the 63 use cases we analyzed, generative AI has the potential to generate $2.6 trillion to $4.4 trillion in value across industries. Its precise impact will depend on a variety of factors, such as the mix and importance of different functions, as well as the scale of an industrys revenue (Exhibit 4).

For example, our analysis estimates generative AI could contribute roughly $310 billion in additional value for the retail industry (including auto dealerships) by boosting performance in functions such as marketing and customer interactions. By comparison, the bulk of potential value in high tech comes from generative AIs ability to increase the speed and efficiency of software development (Exhibit 5).

In the banking industry, generative AI has the potential to improve on efficiencies already delivered by artificial intelligence by taking on lower-value tasks in risk management, such as required reporting, monitoring regulatory developments, and collecting data. In the life sciences industry, generative AI is poised to make significant contributions to drug discovery and development.

We share our detailed analysis of these industries below.

Technology has been changing the anatomy of work for decades. Over the years, machines have given human workers various superpowers; for instance, industrial-age machines enabled workers to accomplish physical tasks beyond the capabilities of their own bodies. More recently, computers have enabled knowledge workers to perform calculations that would have taken years to do manually.

These examples illustrate how technology can augment work through the automation of individual activities that workers would have otherwise had to do themselves. At a conceptual level, the application of generative AI may follow the same pattern in the modern workplace, although as we show later in this chapter, the types of activities that generative AI could affect, and the types of occupations with activities that could change, will likely be different as a result of this technology than for older technologies.

The McKinsey Global Institute began analyzing the impact of technological automation of work activities and modeling scenarios of adoption in 2017. At that time, we estimated that workers spent half of their time on activities that had the potential to be automated by adapting technology that existed at that time, or what we call technical automation potential. We also modeled a range of potential scenarios for the pace at which these technologies could be adopted and affect work activities throughout the global economy.

Technology adoption at scale does not occur overnight. The potential of technological capabilities in a lab does not necessarily mean they can be immediately integrated into a solution that automates a specific work activitydeveloping such solutions takes time. Even when such a solution is developed, it might not be economically feasible to use if its costs exceed those of human labor. Additionally, even if economic incentives for deployment exist, it takes time for adoption to spread across the global economy. Hence, our adoption scenarios, which consider these factors together with the technical automation potential, provide a sense of the pace and scale at which workers activities could shift over time.

The analyses in this paper incorporate the potential impact of generative AI on todays work activities. The new capabilities of generative AI, combined with previous technologies and integrated into corporate operations around the world, could accelerate the potential for technical automation of individual activities and the adoption of technologies that augment the capabilities of the workforce. They could also have an impact on knowledge workers whose activities were not expected to shift as a result of these technologies until later in the future (see sidebar About the research).

Based on developments in generative AI, technology performance is now expected to match median human performance and reach top-quartile human performance earlier than previously estimated across a wide range of capabilities (Exhibit 6). For example, MGI previously identified 2027 as the earliest year when median human performance for natural-language understanding might be achieved in technology, but in this new analysis, the corresponding point is 2023.

As a result of these reassessments of technology capabilities due to generative AI, the total percentage of hours that could theoretically be automated by integrating technologies that exist today has increased from about 50 percent to 6070 percent. The technical potential curve is quite steep because of the acceleration in generative AIs natural-language capabilities.

Interestingly, the range of times between the early and late scenarios has compressed compared with the expert assessments in 2017, reflecting a greater confidence that higher levels of technological capabilities will arrive by certain time periods (Exhibit 7).

Our analysis of adoption scenarios accounts for the time required to integrate technological capabilities into solutions that can automate individual work activities; the cost of these technologies compared with that of human labor in different occupations and countries around the world; and the time it has taken for technologies to diffuse across the economy. With the acceleration in technical automation potential that generative AI enables, our scenarios for automation adoption have correspondingly accelerated. These scenarios encompass a wide range of outcomes, given that the pace at which solutions will be developed and adopted will vary based on decisions that will be made on investments, deployment, and regulation, among other factors. But they give an indication of the degree to which the activities that workers do each day may shift (Exhibit 8).

As an example of how this might play out in a specific occupation, consider postsecondary English language and literature teachers, whose detailed work activities include preparing tests and evaluating student work. With generative AIs enhanced natural-language capabilities, more of these activities could be done by machines, perhaps initially to create a first draft that is edited by teachers but perhaps eventually with far less human editing required. This could free up time for these teachers to spend more time on other work activities, such as guiding class discussions or tutoring students who need extra assistance.

Our previously modeled adoption scenarios suggested that 50 percent of time spent on 2016 work activities would be automated sometime between 2035 and 2070, with a midpoint scenario around 2053. Our updated adoption scenarios, which account for developments in generative AI, models the time spent on 2023 work activities reaching 50 percent automation between 2030 and 2060, with a midpoint of 2045an acceleration of roughly a decade compared with the previous estimate.

Adoption is also likely to be faster in developed countries, where wages are higher and thus the economic feasibility of adopting automation occurs earlier. Even if the potential for technology to automate a particular work activity is high, the costs required to do so have to be compared with the cost of human wages. In countries such as China, India, and Mexico, where wage rates are lower, automation adoption is modeled to arrive more slowly than in higher-wage countries (Exhibit 9).

Previous generations of automation technology were particularly effective at automating data management tasks related to collecting and processing data. Generative AIs natural-language capabilities increase the automation potential of these types of activities somewhat. But its impact on more physical work activities shifted much less, which isnt surprising because its capabilities are fundamentally engineered to do cognitive tasks.

As a result, generative AI is likely to have the biggest impact on knowledge work, particularly activities involving decision making and collaboration, which previously had the lowest potential for automation (Exhibit 10). Our estimate of the technical potential to automate the application of expertise jumped 34 percentage points, while the potential to automate management and develop talent increased from 16 percent in 2017 to 49 percent in 2023.

Generative AIs ability to understand and use natural language for a variety of activities and tasks largely explains why automation potential has risen so steeply. Some 40 percent of the activities that workers perform in the economy require at least a median level of human understanding of natural language.

As a result, many of the work activities that involve communication, supervision, documentation, and interacting with people in general have the potential to be automated by generative AI, accelerating the transformation of work in occupations such as education and technology, for which automation potential was previously expected to emerge later (Exhibit 11).

Labor economists have often noted that the deployment of automation technologies tends to have the most impact on workers with the lowest skill levels, as measured by educational attainment, or what is called skill biased. We find that generative AI has the opposite patternit is likely to have the most incremental impact through automating some of the activities of more-educated workers (Exhibit 12).

Another way to interpret this result is that generative AI will challenge the attainment of multiyear degree credentials as an indicator of skills, and others have advocated for taking a more skills-based approach to workforce development in order to create more equitable, efficient workforce training and matching systems. Generative AI could still be described as skill-biased technological change, but with a different, perhaps more granular, description of skills that are more likely to be replaced than complemented by the activities that machines can do.

Previous generations of automation technology often had the most impact on occupations with wages falling in the middle of the income distribution. For lower-wage occupations, making a case for work automation is more difficult because the potential benefits of automation compete against a lower cost of human labor. Additionally, some of the tasks performed in lower-wage occupations are technically difficult to automatefor example, manipulating fabric or picking delicate fruits. Some labor economists have observed a hollowing out of the middle, and our previous models have suggested that work automation would likely have the biggest midterm impact on lower-middle-income quintiles.

However, generative AIs impact is likely to most transform the work of higher-wage knowledge workers because of advances in the technical automation potential of their activities, which were previously considered to be relatively immune from automation (Exhibit 13).

Global economic growth was slower from 2012 to 2022 than in the two preceding decades. Although the COVID-19 pandemic was a significant factor, long-term structural challengesincluding declining birth rates and aging populationsare ongoing obstacles to growth.

Declining employment is among those obstacles. Compound annual growth in the total number of workers worldwide slowed from 2.5 percent in 197282 to just 0.8 percent in 201222, largely because of aging. In many large countries, the size of the workforce is already declining. Productivity, which measures output relative to input, or the value of goods and services produced divided by the amount of labor, capital, and other resources required to produce them, was the main engine of economic growth in the three decades from 1992 to 2022 (Exhibit 14). However, since then, productivity growth has slowed in tandem with slowing employment growth, confounding economists and policy makers.

The deployment of generative AI and other technologies could help accelerate productivity growth, partially compensating for declining employment growth and enabling overall economic growth. Based on our estimates, the automation of individual work activities enabled by these technologies could provide the global economy with an annual productivity boost of 0.2 to 3.3 percent from 2023 to 2040, depending on the rate of automation adoptionwith generative AI contributing 0.1 to 0.6 percentage points of that growthbut only if individuals affected by the technology were to shift to other work activities that at least match their 2022 productivity levels (Exhibit 15). In some cases, workers will stay in the same occupations, but their mix of activities will shift; in others, workers will need to shift occupations.

History has shown that new technologies have the potential to reshape societies. Artificial intelligence has already changed the way we live and workfor example, it can help our phones (mostly) understand what we say, or draft emails. Mostly, however, AI has remained behind the scenes, optimizing business processes or making recommendations about the next product to buy. The rapid development of generative AI is likely to significantly augment the impact of AI overall, generating trillions of dollars of additional value each year and transforming the nature of work.

But the technology could also deliver new and significant challenges. Stakeholders must actand quickly, given the pace at which generative AI could be adoptedto prepare to address both the opportunities and the risks. Risks have already surfaced, including concerns about the content that generative AI systems produce: Will they infringe upon intellectual property due to plagiarism in the training data used to create foundation models? Will the answers that LLMs produce when questioned be accurate, and can they be explained? Will the content generative AI creates be fair or biased in ways that users do not want by, say, producing content that reflects harmful stereotypes?

There are economic challenges too: the scale and the scope of the workforce transitions described in this report are considerable. In the midpoint adoption scenario, about a quarter to a third of work activities could change in the coming decade. The task before us is to manage the potential positives and negatives of the technology simultaneously (see sidebar Using generative AI responsibly). Here are some of the critical questions we will need to address while balancing our enthusiasm for the potential benefits of the technology with the new challenges it can introduce.

How can companies move quickly to capture the potential value at stake highlighted in this report, while managing the risks that generative AI presents?

How will the mix of occupations and skills needed across a companys workforce be transformed by generative AI and other artificial intelligence over the coming years? How will a company enable these transitions in its hiring plans, retraining programs, and other aspects of human resources?

Do companies have a role to play in ensuring the technology is not deployed in negative use cases that could harm society?

How can businesses transparently share their experiences with scaling the use of generative AI within and across industriesand also with governments and society?

What will the future of work look like at the level of an economy in terms of occupations and skills? What does this mean for workforce planning?

How can workers be supported as their activities shift over time? What retraining programs can be put in place? What incentives are needed to support private companies as they invest in human capital? Are there earn-while-you-learn programs such as apprenticeships that could enable people to retrain while continuing to support themselves and their families?

What steps can policy makers take to prevent generative AI from being used in ways that harm society or vulnerable populations?

Can new policies be developed and existing policies amended to ensure human-centric AI development and deployment that includes human oversight and diverse perspectives and accounts for societal values?

How concerned should individuals be about the advent of generative AI? While companies can assess how the technology will affect their bottom lines, where can citizens turn for accurate, unbiased information about how it will affect their lives and livelihoods?

How can individuals as workers and consumers balance the conveniences generative AI delivers with its impact in their workplaces?

Can citizens have a voice in the decisions that will shape the deployment and integration of generative AI into the fabric of their lives?

Technological innovation can inspire equal parts awe and concern. When that innovation seems to materialize fully formed and becomes widespread seemingly overnight, both responses can be amplified. The arrival of generative AI in the fall of 2022 was the most recent example of this phenomenon, due to its unexpectedly rapid adoption as well as the ensuing scramble among companies and consumers to deploy, integrate, and play with it.

All of us are at the beginning of a journey to understand this technologys power, reach, and capabilities. If the past eight months are any guide, the next several years will take us on a roller-coaster ride featuring fast-paced innovation and technological breakthroughs that force us to recalibrate our understanding of AIs impact on our work and our lives. It is important to properly understand this phenomenon and anticipate its impact. Given the speed of generative AIs deployment so far, the need to accelerate digital transformation and reskill labor forces is great.

These tools have the potential to create enormous value for the global economy at a time when it is pondering the huge costs of adapting and mitigating climate change. At the same time, they also have the potential to be more destabilizing than previous generations of artificial intelligence. They are capable of that most human of abilities, language, which is a fundamental requirement of most work activities linked to expertise and knowledge as well as a skill that can be used to hurt feelings, create misunderstandings, obscure truth, and incite violence and even wars.

We hope this research has contributed to a better understanding of generative AIs capacity to add value to company operations and fuel economic growth and prosperity as well as its potential to dramatically transform how we work and our purpose in society. Companies, policy makers, consumers, and citizens can work together to ensure that generative AI delivers on its promise to create significant value while limiting its potential to upset lives and livelihoods. The time to act is now.

Continued here:
Economic potential of generative AI - McKinsey

The Intersection of Reinforcement Learning and Deep Learning – CityLife

Exploring the Synergy between Reinforcement Learning and Deep Learning in Modern AI Applications

The intersection of reinforcement learning and deep learning has emerged as a promising frontier in the field of artificial intelligence (AI). As researchers and engineers continue to push the boundaries of what AI can achieve, the combination of these two techniques has become increasingly important in developing cutting-edge applications. This article will explore the synergy between reinforcement learning and deep learning, and how their fusion is shaping the future of AI.

Reinforcement learning (RL) is a type of machine learning where an agent learns to make decisions by interacting with an environment. The agent receives feedback in the form of rewards or penalties, which it uses to adjust its actions to maximize the cumulative reward over time. This trial-and-error approach enables the agent to learn complex behaviors without explicit supervision, making it well-suited for tasks where the optimal solution is not known in advance.

Deep learning, on the other hand, is a subset of machine learning that focuses on neural networks with many layers. These deep neural networks are capable of learning hierarchical representations of data, enabling them to automatically extract useful features and make predictions based on raw input. This has led to breakthroughs in various domains, such as image recognition, natural language processing, and speech recognition.

The fusion of reinforcement learning and deep learning, known as deep reinforcement learning (DRL), has shown great potential in tackling complex problems that were previously considered intractable. One of the most notable successes of DRL is the development of AlphaGo, a computer program developed by DeepMind that defeated the world champion of the ancient board game Go. This achievement was considered a major milestone in AI, as Go is a highly complex game with more possible board configurations than there are atoms in the universe.

The key to AlphaGos success was the combination of deep learning for pattern recognition and reinforcement learning for decision-making. The deep neural networks were used to evaluate the potential outcomes of different moves, while the reinforcement learning algorithm guided the search for the best move by exploring and exploiting the game tree. This approach allowed AlphaGo to learn from both human expert games and self-play, ultimately mastering the game at a superhuman level.

The success of AlphaGo has inspired researchers to explore the potential of deep reinforcement learning in other domains. One promising area is robotics, where DRL can be used to teach robots to perform complex tasks, such as grasping objects, walking, or flying. By combining the ability of deep learning to process high-dimensional sensory data with the trial-and-error learning of reinforcement learning, robots can learn to navigate and interact with their environment in a more natural and efficient way.

Another exciting application of DRL is in the field of autonomous vehicles. By training self-driving cars using deep reinforcement learning, researchers hope to develop systems that can safely and efficiently navigate complex traffic scenarios. This approach has the potential to revolutionize transportation, reducing accidents and improving traffic flow.

In the healthcare sector, DRL is being explored for drug discovery and personalized medicine. By leveraging the power of deep learning to analyze large-scale biomedical data and reinforcement learning to optimize treatment strategies, researchers aim to develop AI systems that can assist in the discovery of new drugs and the customization of treatments for individual patients.

In conclusion, the intersection of reinforcement learning and deep learning is proving to be a fertile ground for innovation in AI. By combining the strengths of these two techniques, researchers are making significant strides in solving complex problems across various domains. As the synergy between reinforcement learning and deep learning continues to be explored, we can expect to see even more groundbreaking advancements in the field of artificial intelligence.

More here:
The Intersection of Reinforcement Learning and Deep Learning - CityLife

Chinese AI Giant SenseTime Unveils USD559 Robot That Can Play … – Yicai Global

Yicai Global) June 15 -- SenseTime Group, a leading Chinese developer of artificial intelligence software, has unveiled a USD3,999 (USD559) AI-powered robot that can play Chinese board game Go.

SenseRobot uses robotic arms to play Go against people on a real board, Yicai Global learned at yesterday's launch event in Shanghai. It has several difficulty levels to meet different needs, from beginners to professionals.

In 2016, Google's AI lab DeepMind developed AlphaGo, a Go computer program that defeated world champion Lee Sedol, becoming a hot topic in the field of science and technology. But AlphaGo was only a prototype, not accessible to ordinary families.

SenseRobot managed to integrate huge computing power into a very small hardware, Shen Hui, dean of SenseTime's Innovative Engineering Institute, told Yicai Global.

Last August, SenseTime introduced the first generation of SenseRobot that can play Chinese chess. Compared with the previous generation, the newest Go robot optimized its algorithm and computing power that can be reinforced by the cloud server in games against professionals, Shen noted.

The advent of large language models has helped a lot in product iterations, and chatbot capabilities have been widely used in developing SenseRobot to improve its research and development performance and efficiency, Shen added.

After ChatGPT went viral, Chinese tech giants, including Baidu and Alibaba Group Holding, have launched similar products. In April, SenseTime released LLM SenseChat and SenseNova, an AI model training system.

SenseTime's shares [HK: 0020] were trading down 0.4 percent at HKD2.25 (29 US cents) as of 11.25 a.m. today. They have plunged nearly 41 percent since their listing in December 2021.

Editors: Dou Shicong, Futura Costaglione

Visit link:
Chinese AI Giant SenseTime Unveils USD559 Robot That Can Play ... - Yicai Global

Cyber attacks on AI a problem for the future – Verdict

Although the use of artificial intelligence (AI) is accelerating in security, its increased use could actually invite AI cyber attacks (including adversarial attacks) in varied systems, devices and applications.

Recent advances around the improvement of algorithms (Googles AlphaGo, OpenAIs GPT-3), and increasing computing power have accelerated AI across a number of potential applications and use cases.

Use cases stem across Automotive (computer vision and conversational platforms), Consumer Electronics (implementing virtual assistants, authentication via facial recognition, i.e. Apples FaceID), and Ecommerce and Retail (voice-enabled shopping assistants, personalized shop). Accordingly, based on GlobalData forecasts, the total AI market is demonstrating strong growth (includes software, hardware, and services) and will be worth $383.3bn in 2030, having grown at a compound annual growth rate (CAGR) of 21.4% from $81.3bn in 2022. As a result many of these use cases will be across a number of consumer and business application settings.

AI within cybersecurity is very much talked about in how AI can be utilized to increase cyber resiliency, simplify processes, and perform human functions. AI together with Automation and Analytics enables managed security providers to ingest data from multiple feeds and react more quickly to real threats, and apply automation to incidence response in a broader way.

AI in cybersecurity is also seen to solve the problem in the long run of resourcing, by in the short term providing a stop gap by streamlining human functions across Security Operations Centers (SOCs) this could be through for example cybersecurity technology components covering Extended, Detection and Response (XDR) that detect sophisticated threats with AI; and Security Orchestration, Automation and Response (SOAR) platforms that utilize Machine Learning (ML) to provide incident handling guidance based on past actions and historical data.

On the flip side, the increased use of AI in all applications (including cybersecurity) increases the chances of attacks on the actual AI/ML models in varied systems, devices and applications. In addition, adversarial attacks on AI could cause models to misinterpret information. There are many use cases that this could occur, and examples include iPhones FaceID access feature that makes use of neural networks to recognize faces Here there is potential for attacks to happen through the AI models themselves and in bypassing the security layers.

Cybersecurity products where AI is implemented is also a target as AI in cybersecurity entails acquiring data sets over time which are vulnerable to attacks. Other examples include algorithm theft in autonomous vehicles, predictive maintenance algorithms in sectors like Oil &Gas and Utilities which could be subject to State Sponsored attacks, identification breaches in video surveillance, and medical misdiagnosis in Healthcare.

The discussion of countering attacks on AI will gain momentum over the next two years as AI use cases increase. Regulations around AI security will also drive momentum and frameworks in place to address cyber attacks on AI.

As an example, current regulatory examples at a vertical level include The European Telecommunications Standards Institute (ETSI) Industry Specification Group for Telecoms that is focusing on utilizing AI to enhance security and securing AI attacks.

The Financial sector as a whole is in its infancy in terms of setting and implementing AI regulatory frameworks. Though, there have been developments in Europe for example, and the European Commission published a comprehensive set of proposals for the AI Act. However, the security component is limited.

The lack of guidance and regulation currently leaves a number of vertical sectors like Finance and Utilities vulnerable.

However, as more AI regulatory frameworks in the context of security are introduced, this could pave way to the rise of managed services specifically at addressing attacks on AI service propositions could entail looking at risk management profiles and laying down security layers around vulnerability assessments, and better integration of MLOps and SIEM/SOAR environments.

Visit link:
Cyber attacks on AI a problem for the future - Verdict

Taming AI to the benefit of humans – Asia News NetworkAsia News … – asianews.network

May 19, 2023

BEIJING For decades, artificial intelligence (AI) has captivated humanity as an enigmatic and elusive entity, often depicted in sci-fi films. Will it emerge as a benevolent angel, devotedly serving mankind, or a malevolent demon, poised to seize control and annihilate humanity?

Previous sci-fi movies featuring AI often portray evil-minded enemies set on destroying humanity, such as The Terminator, The Matrix and Blade Runner. Experts, including late British theoretical physicist Stephen Hawking and Tesla CEO Elon Musk, have expressed concern about the potential risks of AI, with Hawking warning that it could lead to the end of the human race. These tech gurus understand the limitations of human intelligence when compared to rapidly evolving technologies like supercomputers, Big Data and cloud computing, and fear that AI will soon become too powerful to control.

In March 2016, AlphaGo, a computer program developed by Google DeepMind, decisively beat Lee Sedol, a 9-dan Korean professional Go player, with a score of 4-1. In May 2017, AlphaGo crushed Kejie 3-0, Chinas then-top Go player. This historic event marked the first time a machine had defeated a human at Go, widely considered one of the most complex and challenging games in the world. The victory shattered skepticism about AIs capabilities and instilled a sense of awe and fear in many. This sentiment was further reinforced when Master, the updated version of AlphaGo, achieved an unprecedented 60-game winning streak, beating dozens of top-notch players from China, South Korea and Japan, driving human players to despair.

These victories sparked widespread interest and debate about the potential of AI and its impact on society. Some saw it as a triumph of human ingenuity and technological progress, while others expressed concern about the implications for employment, privacy and ethics. Overall, AlphaGos dominance in Go signaled a turning point in the history of AI and became a reminder of the power and potential of this rapidly evolving field.

If AlphaGo was an AI prodigy that impressed humans with its exceptional abilities, then Chat GPT, which made its debut earlier this year, along with its more powerful successor GPT, has left humans both awestruck with admiration and fearful of its potential negative impact.

GPT, or Generative Pre-trained Transformer, a language model AI, has the ability to generate human-like responses to text prompts, making it seem like you are having a conversation with a human. GPT-3, the latest version of the model, has 175 billion parameters, making it the largest language model AI to date. Some have claimed that it has passed the Turing test.

Indisputably, AI has the potential to revolutionize many industries, from healthcare and education to finance and manufacturing to transportation, by providing more accurate diagnoses, reducing accidents and analyzing large amounts of data. It is anticipated that AIs rapid development will bring immeasurable benefits to humans.

Yet, history has shown us that major technological advancements can be a double-edged sword, capable of bringing both benefits and drawbacks. For instance, the discovery of nuclear energy has led to the creation of nuclear weapons, which have caused immense destruction and loss of life. Similarly, the widespread use of social media has revolutionized communication, but it has also led to the spread of misinformation and cyberbullying.

Despite their impressive performance, the latest versions of GPT and its Chinese counterparts, such as Baidus Wenxin Yiyan, are not entirely reliable or trustworthy due to fatal bugs. Despite my attempts to request specific metrical poems by famous ancient Chinese poets, these seemingly omniscient chatbots would display fake works they had cobbled together from their database instead of authentic ones. Even when I corrected them, they would continue to provide incorrect answers without acknowledging their ignorance. Until this bug is resolved, these chatbots cannot be considered a reliable tool.

Furthermore, AI has advanced in image and sound generation through deep learning and neural networks, including the use of GANs for realistic images and videos and text-to-speech algorithms for human-like speech. However, without strict monitoring, these advancements could be abused for criminal purposes, such as deepfake technology for creating convincing videos of people saying or doing things they never did, leading to the spread of false information or defamation.

It has been discovered that AI is being used for criminal purposes. On April 25th, the internet security police in Pingliang City, Gansu Province, uncovered an article claiming that nine people had died in a train collision that morning. Further investigation revealed that the news was entirely false. The perpetrator, a man named Hong, had utilized ChatGPT and other AI products to generate a large volume of fake news and profit illegally. Hongs use of AI tools allowed him to quickly search for and edit previous popular news stories, making them appear authentic and facilitating the spread of false information. In this case, AI played a significant role in the commission of the crime.

Due to the potential risks that AI poses to human society, many institutions worldwide have imposed bans or restrictions on GPT usage, citing security risks and plagiarism concerns. Some countries have also requested that GPT meet specific requirements, such as the European Unions proposed regulations that mandate AI systems to be transparent, explainable and subject to human oversight.

China has always prioritized ensuring the safety, reliability and controllability of AI to better empower global sustainable development. In its January 2023 Position Paper on Strengthening Ethical Governance of Artificial Intelligence, China actively advocates for the concepts of people-oriented and AI for good.

In conclusion, while AI is undoubtedly critical to technological and social advancement, it must be tamed to serve humankind as a law-abiding and people-oriented assistant, rather than a deceitful and rebellious troublemaker. Ethics must take precedence, and legislation should establish regulations and accountability mechanisms for AI. An international consensus and concerted action are necessary to prevent AI from endangering human society.

Read the original:
Taming AI to the benefit of humans - Asia News NetworkAsia News ... - asianews.network