Google’s ambient computing vision is changing how the company works – The Verge
The story of this years Google I/O actually started three years ago.
At I/O 2019, onstage at the Shoreline Auditorium in Mountain View, California, Rick Osterloh, Googles SVP of devices and services, laid out a new vision for the future of computing. In the mobile era, smartphones changed the world, he said. Its super useful to have a powerful computer wherever you are. But he described an even more ambitious world beyond that, where your computer wasnt a thing in your pocket at all. It was all around you. It was everything. Your devices work together with services and AI, so help is anywhere you want it, and its fluid. The technology just fades into the background when you dont need it. So the devices arent the center of the system you are. He called the idea ambient computing, nodding to a concept that has floated around Amazon, Apple, and other companies over the last few years.
One easy way to interpret ambient computing is around voice assistants and robots. Put Google Assistant in everything, yell at your appliances, done and done. But thats only the very beginning of the idea. The ambient computer Google imagines is more like a guardian angel or a super-sentient Star Wars robot. Its an engine that understands you completely and follows you around, churning through and solving for all the stuff in your life. The small (whens my next appointment?) and the big (help me plan my wedding) and the mundane (turn the lights off) and the life-changing (am I having a heart attack?). The wheres and whens and hows dont matter, only the whats and whys. The ambient computer isnt a gadget its almost a being; its the greater-than-the-sum-of-its-parts whole that comes out of a million perfectly-connected things.
Which is a problem for Google. The company is famously decentralized and non-hierarchical, and it can sometimes seem like every single engineer on staff is given the green light to ship whatever they made that week. And so, since that day in 2019, Google has mostly continued to do what Google always does, which is build an unbelievable amount of stuff, often without any discernible strategy or plan behind it. Its not that Google didnt have a bigger vision; its just that no one seemed to be interested in doing the connective work required for the all-encompassing, perfectly-connected future Osterloh had imagined. Google was becoming a warehouse full of cool stuff rather than an ecosystem.
But over the last couple of years, Google has begun to change in order to meet this challenge. Osterlohs devices team, for instance, has completely reset its relationship with the Android team. For a long time, the company proudly maintained a wall between Pixel and Android, treating its internal hardware team like any other manufacturer. Now, Google treats Pixel like the tip of the spear: its meant to be both a flagship device and a development platform through which Google can build features it then shares with the rest of the ecosystem.
We really sort of co-design where things are headed, Osterloh said. I think thats just sort of the nature of how computers have changed, and computing models have changed. Both teams share visions of an ambient future, he said. And were working on it together.
Around the company, these related teams and products are starting to come closer together. Theyre building on unified tech, like Googles custom Tensor processors, and on common concepts like conversational AI.
As a result, Google I/O feels unusually coherent this year. Google is trying harder than I can remember to build products that not only work well but work well together. Search is becoming a multisensory, multi-device proposition that understands both whos searching and what theyre really looking for. Its also extending the search experience far beyond just questions and answers. Its making Android more context- and content-aware so that your phone changes to match the things you do on it. Its emphasizing natural interactions so that you can get information without memorizing a rigid set of commands. Its building the hardware ecosystem it needs to make all that work everywhere and the software to match.
Now, lets be very clear: Googles work is only just beginning. It has to win market share in device categories it has failed for years to capture. It has to build new experiences inside new and old devices. It has to figure out how to solve Android fragmentation between its devices and the market-leading devices from companies like Samsung, which might be the hardest part of all. And it has to become more present in users lives and extract more information from them, all without upsetting regulators, screwing up the search-ads business, or violating users privacy. The ambient computer was never going to come easily, and Google has made its own efforts harder in countless ways over the years.
But at the very least, the company seems to finally understand what an ambient computer requires and why it has Assistant! is not a sufficient answer and is beginning the work to get it done.
When I sat down with Osterloh over a video call a few days before I/O, he began to wax poetic about Googles hardware division, every so often glancing down just out of frame. I asked what he was looking at, suddenly suspicious it was a bunch of unreleased devices. I was right. This is Pixel 6, he said, holding up his current device. And then, I have a Pixel 6A, in a very disguised case, this time holding up a black brick of rubber surrounding the unreleased device. And I have a Pixel 7, also in disguise. He held up his wrist, too, with a Pixel Watch strapped to it.
As we talked, Osterloh reiterated the usual Google pitch for ambient computing, but this time, it came with a bit of a twist to the familiar. The long-term vision is still an always-there version of Google that works everywhere with everything all the time, but right now? Right now, its still all about the ultra-fast processor in your pocket. Certainly for the foreseeable future, we feel like the most crucial part of that is the pocketable computer, the mobile phone, he said. The smartphone is the center of the computing universe for billions of users around the globe, and so the first version of Osterlohs ambient computer will be built around a smartphone, too.
Thats why, when Google set out to make the Pixel 6A which is largely a cost-cutting exercise, trying to turn a $600 phone into a still-credible $449 one one expensive part survived the cut. The target of what Pixel is, is about having an awesome user experience that keeps getting better over time, Osterloh said. And with that as the core, what you realize is like the thing that is essential to have across these devices is Tensor.
The Google-designed Tensor processor was the key feature introduced alongside the Pixel 6, largely as a way to improve its on-device AI capabilities for speech recognition and more. And now, it seems, its going to be a staple of the line: Osterloh said all the upcoming Pixel phones and even the Android-powered tablet the team is working on for release next year will run on its Tensor processor.
The smartphone is the center of the universe for now, but you can already start to see how that might change. The new Pixel Buds Pro are a powerful set of noise-canceling headphones, for instance, but also a hands-free interface into a wirelessly connected computing device.
Devices that can be close to your ear and enable you to have real-time communication with the computer are an absolutely essential part of ambient computing, Osterloh said, noting that he now does most of his emailing via voice. Similarly, the new Pixel Watch is, in some ways, a phone accessory, delivering notifications and the like to your wrist and offering another interface to the same power in your pocket. But Googles also selling an LTE version, so youll be able to access Assistant or pay with Google Wallet without needing your phone nearby. And that tablet, whenever it comes, will have all the same Pixel capabilities in a bigger shell.
The point is that it doesnt matter, in the long run, which device you use. Where the computing capability is, and how powerful the devices themselves are, shouldnt matter to the user, Osterloh said. I think what they should see is increasing capabilities.
The Pixel and Android teams have recently adopted a sort of mantra: Better Together. Much of whats new this year in Android 13 is not whizbang new features but small tweaks meant to make the ecosystem a little more seamless. Through an update to the Chrome OS Phone Hub feature, youll be able to use all your messaging apps on your Chromebook just as you would on your phone. Support for the Matter smart home standard now comes built into Android, which should make setting up and controlling new devices much easier. Googles extending support for its Cast protocols for sending audio and video to other devices and improving its Fast Pair services to make it easy to connect Bluetooth devices. It has been talking about these features since CES in January and has signed up an impressive list of partners.
It sounds a bit like Google finally watched an Apple ad and discovered that making hardware and software together really does help. Who knew! But Googles position is genuinely tricky here. Googles ad business relies on a mind-bendingly huge scale, which it gets mostly thanks to other companies building Android products. That means Google has to keep all those partners happy and feeling like theyre on a level playing field with the Pixel team. And it simply cant control its ecosystem like Apple can. It is forever worrying about backward compatibility and how things will work on devices of all sizes, prices, and power. It has to engender support to make big changes, whereas Apple just brute-forces the future.
But Google has become increasingly bold in pushing ahead with the Pixel brand. It can afford to because Pixel is hardly a real sales threat to Samsung and others. (Besides, where are Android manufacturers going to go? Windows Mobile?) But it also has to because Google only wins if the ecosystem buys in, and Pixel is Googles best chance to model what the entire Android ecosystem should look like. Thats what Osterloh sees as his job and, in large part, his teams reason for being.
If Pixels never going to be a smash-hit bestseller (and it looks like it wont be), the only way Google can win in the long run is to use it as a way to pressure Samsung and others to keep up Googles features and ideas. Google has a chance to lead even more in tablets and smartwatches, two Android markets in desperate need of a path forward. Phone is certainly super important, said Sameer Samat, a VP of product management on the Android team. But its also becoming very clear that there are other device form factors which are complementary and also critical to a consumer deciding which ecosystem to buy into, and which ecosystem to live.
Thats another way of saying the only way Google can get to its ambient computing dreams is to make sure Google is everywhere. Like, literally everywhere. Thats why Google continues to invest in products in seemingly every square inch of your life, from your TV to your thermostat to your car to your wrist to your ears. The ambient-computing future may be one computer to rule them all, but that computer needs a near-infinite set of user interfaces.
The second step to making ambient computing work is to make it really, really easy to use. Google is relentlessly trying to whittle away every bit of friction involved in accessing its services, particularly the Assistant. For instance, if you own a Nest Hub Max, youll soon be able to talk to it just by looking into its camera, and youll be able to set timers or turn off the lights without issuing a command at all.
Its kind of like you and I having a conversation, said Nino Tasca, a director of product management on Googles speech team. Sometimes, Ill use your name to start a conversation. But if Im already staring at you and ask you directly, you know Im talking to you. Google is obsessed with making everything natural and conversational because its convinced that making it easy is actually more important than making it fast.
The same logic applies to search, which is quickly becoming a multi-sensory, multi-modal thing. The way you search for information shouldnt be constrained to typing keywords into a search box, said Prabhakar Raghavan, Googles SVP for knowledge and information products. Our vision is to make the whole world around you searchable, so you can find helpful information about whatever you see, hear and experience, in whichever ways are most natural to you.
That has forced Google to reinvent both the input of search, leaning on voice and images just as much as the text box, as well as the output. Some people really find it easy to process video, said Liz Reid, a VP of engineering on the search team, and other people will find it distracting. On the other hand, some peoples literacy is not as good, and so a long web page that you have to read through not only takes time, but theyre gonna get lost, and a video thats spoken in their language is really intuitive. Google built one hell of a text box, but its not enough anymore.
The most obvious outpouring of that work is multisearch. Using the Google app, you can take a photo of a dress in Googles examples, its always a dress and then type green to search for that dress but in green. Thats the kind of thing you just couldnt do in a text box.
And at I/O, Google also showed off a tool for running multisearch on an image with multiple things in it: take a picture of the peanut butter aisle, type nut-free, and Google will tell you which one to buy. We find when we unlock new capabilities that people had information needs that were just too hard to express, Reid said. And then they start expressing them on there. Search used to be one thing, Lens was another, voice was a third, but when you combine them, new things become possible.
But the real challenge for Google is that its much more than a question-and-answer engine now. Whats best isnt really, in many of these cases, a strict stack rank, right? Reid said. A lot of these newer use cases, theres a style or a taste component. Shopping has become important to Google, for instance, but theres no single correct answer for best t-shirt. Plus, Google is using search more and more as a way to keep you inside Googles ecosystem; the search box is increasingly just a launcher to various Google things.
So rather than just aiming to understand the internet, Google has to learn to understand its users better than ever. Does it help that Google has a massive store of first-party data that it has collected over the last couple of decades on billions of people around the world? Of course it does! But even that isnt enough to get Google where its going.
About the ads: dont forget the fact that even in a world outside the search box, Googles still an advertising business. Just as Amazons ambient computing vision seems to always come back to selling you things, Googles will always come back to showing you ads. And the thing about Googles whole vision is that it means a company that knows a lot about you and seems to follow you everywhere will know even more about you and follow you even more places.
Google seems to be going out of its way to try and make users feel comfortable with its presence: its moving more AI to devices themselves instead of processing and storing everything in the cloud, its pushing toward new systems of data collection that dont so cleanly identify an individual, and its offering users more ways to control their own privacy and security settings. But the ambient-computer life requires a privacy tradeoff all the same, and Google is desperate to make it good enough that its worth it. Thats a high bar and getting higher all the time.
Actually, this whole process is full of high bars for Google. If it wants to build an ambient computer that can truly be all things to all people, its going to need to build a sweeping ecosystem of hugely popular devices that all run compatible software and services while also seamlessly integrating with a massive global ecosystem of other devices, including those made by its direct competitors. And thats just to build the interface. Past that, Google has to turn the Assistant into something genuinely pleasurable to interact with all day and make its services flex to every need and workflow of users across the globe. Nothing about that will be easy.
But if you squint a little, you can see what it would look like. And thats what has been so frustrating about Googles approach in recent years: it feels like all the puzzle pieces to the future are sitting there in Mountain View, strewn around campus with no one paying attention. But now, as a company, Google appears to be starting to assemble them.
See the original post:
Google's ambient computing vision is changing how the company works - The Verge
- STRACKALINE TO OFFER EXCLUSIVE FREE SOFTWARE ACCESS AT THE 2025 PGA SHOW (BOOTH 2808) - The Golf Wire - December 18th, 2024 [December 18th, 2024]
- The Pixel 6 just got a free software upgrade that makes it my favorite budget Android phone - ZDNet - December 12th, 2024 [December 12th, 2024]
- Google just gave older Pixel phones a free software upgrade that you once could only wish for - ZDNet - December 8th, 2024 [December 8th, 2024]
- Free AI-Powered Software for Radiology Impressions Available from Scriptor Software - Imaging Technology News - December 8th, 2024 [December 8th, 2024]
- Maryland State Bar Members Now Get Free Trust Accounting Software in Deal with Smokeball - LawSites - December 5th, 2024 [December 5th, 2024]
- 7 free and open-source tools that rival the best creative software - XDA Developers - December 5th, 2024 [December 5th, 2024]
- Google Drive Full? Gift Yourself More Digital Storage This Holiday Season - CNET - November 30th, 2024 [November 30th, 2024]
- Tired of controller lock-in? Mixxx is a free DJ alternative; 2.4.2 out now - Create Digital Music - November 28th, 2024 [November 28th, 2024]
- 5 of the best free software for data recovery on Windows - XDA Developers - November 23rd, 2024 [November 23rd, 2024]
- AAVAA Hands-Free Accessibility Devices Now Compatible with Apple Software - The Hearing Review - November 17th, 2024 [November 17th, 2024]
- The best graphic design software - Creative Bloq - November 16th, 2024 [November 16th, 2024]
- VMware makes Workstation and Fusion free for everyone - BleepingComputer - November 16th, 2024 [November 16th, 2024]
- Trimble Expands Access to Advanced Construction Project Management Capabilities with Free Version of ProjectSight Software - StreetInsider.com - November 16th, 2024 [November 16th, 2024]
- The best free video editing software: how to cut clips without the cost - Creative Bloq - November 8th, 2024 [November 8th, 2024]
- Best Free Invoice And Billing Software Of 2024 - Forbes - November 8th, 2024 [November 8th, 2024]
- Amazfit just dropped a massive free software update and these new features are coming to your smartwatch - Tom's Guide - November 5th, 2024 [November 5th, 2024]
- The Free Software Foundation Finally Has AI / Machine Learning Apps On Their Radar - Phoronix - October 24th, 2024 [October 24th, 2024]
- Intuit asked us to delete part of this Decoder episode - The Verge - October 24th, 2024 [October 24th, 2024]
- "100% Free" GNU Boot Discovers Again They Have Been Shipping Non-Free Code - Phoronix - October 24th, 2024 [October 24th, 2024]
- The best antivirus software in 2024 for PC - TechRadar - October 24th, 2024 [October 24th, 2024]
- Stunning software giveaway: Save over $500 on tools for video editing, password recovery, and more its all free! - BetaNews - October 18th, 2024 [October 18th, 2024]
- PSA: Windows 10 has entered its final year of free support here's what you need to know - Windows Central - October 18th, 2024 [October 18th, 2024]
- Best video editing software in 2024: free and paid-for tools - Amateur Photographer - October 18th, 2024 [October 18th, 2024]
- Samsung TVs free update to One UI is already happening here are the changes coming to TVs - TechRadar - October 18th, 2024 [October 18th, 2024]
- The best open-source productivity software: Free tools to boost your workflow - XDA Developers - October 9th, 2024 [October 9th, 2024]
- Best tax software of 2024: File fast and accurately, plus get your maximum refund - CNBC - October 7th, 2024 [October 7th, 2024]
- The IRS is expanding its free tax filing service. Do you qualify? - The Washington Post - October 4th, 2024 [October 4th, 2024]
- Explore Top Free Software Alternatives to Popular Paid Programs for Budget-Friendly Solutions - Gizbot - October 4th, 2024 [October 4th, 2024]
- The best free video players in 2024: watch videos in any format - TechRadar - October 4th, 2024 [October 4th, 2024]
- Ford unveils BlueCruise 1.4: hands-free driving time doubled with new software update - CBT Automotive News - October 3rd, 2024 [October 3rd, 2024]
- Free Photo Viewer for Windows - Free download and software reviews - Download.com - October 3rd, 2024 [October 3rd, 2024]
- Top 10 Cool Free Windows Software (You'll Really Want) - MSN - October 3rd, 2024 [October 3rd, 2024]
- Best free YouTube to MP3 converter of 2024 - TechRadar - October 3rd, 2024 [October 3rd, 2024]
- The best free alternatives for pricey software: Adios, Office and Adobe - PCWorld - September 28th, 2024 [September 28th, 2024]
- Best Free Accounting Software for Small Businesses (Sponsored content from Jerry) - Varsity Online - September 21st, 2024 [September 21st, 2024]
- WhatsApp for Windows - Free download and software reviews - Download.com - September 21st, 2024 [September 21st, 2024]
- FDA approves some Apple AirPods to be used as hearing aids - NPR - September 16th, 2024 [September 16th, 2024]
- Q-Free releases new flexible, modular, and scalable tolling software solution - Highways News - September 16th, 2024 [September 16th, 2024]
- Clark Center for Geospatial Analytics to offer free version of TerrSet/IDRISI software starting Dec. 2 - Geo Week News - September 3rd, 2024 [September 3rd, 2024]
- Best video editing apps of 2024: Top tools for Android, iPhone, and iPad - TechRadar - September 3rd, 2024 [September 3rd, 2024]
- Samsung extends free software upgrades to millions of Smart TV owners are YOU one of them? - GB News - September 3rd, 2024 [September 3rd, 2024]
- This open-source software can double the volume of Windows laptops. For free - The Indian Express - August 22nd, 2024 [August 22nd, 2024]
- European Commission cuts funding support for Free Software projects - European Digital Rights (EDRi) - August 22nd, 2024 [August 22nd, 2024]
- Hyundai partners with TCSO to combat car thefts with free software patch - KEYE TV CBS Austin - August 22nd, 2024 [August 22nd, 2024]
- Free and Discounted Software for University of Oklahoma Students - The University of Oklahoma - August 16th, 2024 [August 16th, 2024]
- GitHub is the Best Place for Free and Open Source Software - How-To Geek - August 16th, 2024 [August 16th, 2024]
- The Usual Suspects Xenia, a free Waldorf microwave II/XT emulation using the DSP56300 plugin - Synth Anatomy - August 16th, 2024 [August 16th, 2024]
- Best free Adobe Illustrator alternatives of 2024 - TechRadar - June 24th, 2024 [June 24th, 2024]
- This is how to view the long-established free software 'CrystalDiskInfo' that shows the health status and SMART ... - GIGAZINE - June 24th, 2024 [June 24th, 2024]
- The best antivirus software 2024: Free and paid options - Tom's Guide - June 20th, 2024 [June 20th, 2024]
- Best free text-to-speech software of 2024 - TechRadar - May 20th, 2024 [May 20th, 2024]
- Best free word processor of 2024 - TechRadar - May 20th, 2024 [May 20th, 2024]
- Best free antivirus in 2024 - TechRadar - May 20th, 2024 [May 20th, 2024]
- 'Open-Shell Menu' is an open source software that returns the Windows start menu to its previous appearance for free - GIGAZINE - May 20th, 2024 [May 20th, 2024]
- Avast Free Antivirus: Testing its features and learning about the six layers of protection - TechSpot - May 20th, 2024 [May 20th, 2024]
- The best Android antivirus apps in 2024 - Tom's Guide - May 3rd, 2024 [May 3rd, 2024]
- Best photo editing software in 2024 - Tom's Guide - May 3rd, 2024 [May 3rd, 2024]
- BYD recalls 16666 Seagull EVs in China due to software issue that may prevent reverse camera image from displaying - CnEVPost - May 3rd, 2024 [May 3rd, 2024]
- KIA installs free anti-theft software this weekend in St. Louis area - KSDK.com - April 28th, 2024 [April 28th, 2024]
- Best survey tool of 2024 - TechRadar - April 28th, 2024 [April 28th, 2024]
- Grand Rapids Police and Hyundai Offer Free Anti-Theft Software Upgrades Amid Vehicle Theft Wave - Hoodline - April 26th, 2024 [April 26th, 2024]
- Blueprint Software Systems Announces Free Trial for RPA Analytics Solution - PR Web - April 26th, 2024 [April 26th, 2024]
- Houston Police, Hyundai to host free anti-theft security event for vehicle owners - Houston Public Media - April 26th, 2024 [April 26th, 2024]
- Hyundai providing free anti-theft software installation this weekend at Greenspoint Mall - KHOU.com - April 20th, 2024 [April 20th, 2024]
- Ubuntu Studio in new LTS beta; still the easiest creative Linux distro - CDM Create Digital Music - Create Digital Music - April 20th, 2024 [April 20th, 2024]
- How to get free help with income tax prep, or free software | Business | postandcourier.com - The Post and Courier - February 23rd, 2024 [February 23rd, 2024]
- Best encryption software of 2024 - TechRadar - February 23rd, 2024 [February 23rd, 2024]
- The best free VPN in 2024 - TechRadar - February 23rd, 2024 [February 23rd, 2024]
- AI imaging software generates a gallery of stereotypes, says Univ. of ... - GeekWire - November 28th, 2023 [November 28th, 2023]
- Roku's free update that makes it easier to find new shows and ... - TechRadar - November 28th, 2023 [November 28th, 2023]
- How To Find Alternatives To ChatGPT Forbes Advisor UK - Forbes - November 28th, 2023 [November 28th, 2023]
- How To Find Alternatives To ChatGPT Forbes Advisor Australia - Forbes - November 28th, 2023 [November 28th, 2023]
- Assassin's Creed Syndicate is now free to keep on Ubisoft Connect - OC3D - November 28th, 2023 [November 28th, 2023]
- Google Confirms Its Schedule for Disabling Third-Party Cookies in ... - Slashdot - November 28th, 2023 [November 28th, 2023]
- Tata Consultancy Services Ordered To Cough Up $210 Million In ... - Slashdot - November 28th, 2023 [November 28th, 2023]
- Meta Knowingly Collected Data on Pre-Teens, Unredacted ... - Slashdot - November 28th, 2023 [November 28th, 2023]
- US, Britain, Other Countries Ink Agreement To Make AI 'Secure by ... - Slashdot - November 28th, 2023 [November 28th, 2023]
- Plex Users Fear New Feature Will Leak Porn Habits To Their ... - Slashdot - November 28th, 2023 [November 28th, 2023]
- This free software converts drone videos into 2D maps in minutes! - DroneDJ - November 14th, 2023 [November 14th, 2023]
- How 'Hour of Code' Will Teach Students About Issues with AI - Slashdot - November 14th, 2023 [November 14th, 2023]