Google is reportedly looking to sidestep the complexity of AI-driven automation by allowing its multimodal large language models (LLMs) to take control of users’ browsers. As per a report published by The Information, citing several unnamed sources, “Project Jarvis” could be available in inpreview as early as December and enable the model to harness a web browser to "gather research, purchase a product, or book a flight."
The service apparently will be restricted to Chrome and from what users gather will take advantage of Gemini’s ability to parse visual data along with written language to enter text and navigate web pages on the user’s behalf.
This would limit the scope of Project Jarvis’ abilities compared to what Anthropic is doing. Recently, the AI startup detailed how its Claude 3.5 Sonnet model could now use computers to run apps, gather and process information, and perform tasks based on a text prompt.
Also Read: OpenAI Introduces New Canvas Interface For ChatGPT
Google’s AI Agent Is Far From Perfect
Anthropic in a recent blog post said that "a vast amount of modern work happens via computers,” and letting LLMs use existing software the same way people might "will unlock a huge range of applications that simply aren't possible for the current generation of AI assistants."
This kind of automation has been possible using existing tools like Playwright and Puppeteer for some time now. Recently, an AI influencer threw light on his experience using Google’s AI Studio to scrape his display and extract numeric values from emails.
Of course, model vision capabilities are far from perfect and often struggle when it comes to reasoning. When Meta’s Llama 3.2 11B vision model has been put through several tasks and uncovered a number of odd behaviors and the possibility of hallucinations.
Also Read: Intel’s New AI Chips Sending Ripples Across PC Industry
Google Maps Makes Parking Easy With In-App Parking
Google Maps is great at providing directions to users that will lead them to their destination. But what if the service allows you to book a parking spot when users arrive at the location? This has now become a reality with Google Maps adding SpotHero integration.
Currently, SpotHero, a service that enables users to find and reserve parking spaces online, announced that it has entered into a partnership with Google. The company’s service will now be integrated directly into Google Maps and Search.
This development isn’t new, as SpotHero was soft-launched on Maps and Search back in April of this year. However, what’s new is that this functionality is now available to everyone starting today. To use the feature, all users need to do is open one of the two apps and search for parking near their destination. If parking is available, a “Book Online” button will appear. Tapping on the button will send users to the SpotHero website, enabling users to reserve the spot.