The cost per search query with Google and Microsoft chatbots can cost 10 times more than a regular search query
Earlier this month, Google announced plans to launch Bard, an AI chatbot designed to help users find information and interact with humans using a natural language model. A few days earlier, Microsoft also announced a new Bing search experience with an integrated artificial intelligence chatbot that is considered to be more effective in all aspects than the traditional search engine.
However, a common aspect of all this chatbot technology that the host companies do not like to talk about is the operating cost. In a recent interview with Reuters, Alphabet Group President John Hennessy revealed a fact that may surprise many people, which is the total cost of performing a search query with chatbot based on the language model. Large terms can cost 10 times more than current regular search queries.
Back in December 2022, shortly after the launch of ChatGPT, the CEO of OpenAI, Sam Altman, stated on Twitter that the running costs of AI chatbots are very high. This is also part of the reason why OpenAI then decided to launch a paid subscription plan ChatGPT Plus in early February, giving users more features and faster performance for $20 a month.
According to estimates by investment bank Morgan Stanley, Google will cost a fifth of a US cent in operating costs for every time someone performs a search on its service, for a total of 3.3 trillion search queries. search by 2022. However, if an AI chatbot like Bard is put to use, the cost of such a search query could increase up to 10 times.
SemiAnalysis, a research and consulting firm focused on chip technology, said integrating AI chatbots into the search engine could cost Alphabet $3 billion, provided it used an internal Tensor chip made by Google. along with many other optimizations.
The aspect that makes this AI chatbot search query more expensive than regular search lies in the computing power used. It would simply take more CPU performance to generate all the natural-sounding answers possible from an AI chatbot. It also means higher electrical energy costs to keep the servers running.
So what can be done to cut costs? Currently, OpenAI computer scientists are looking for ways to optimize the cost of inference through complex code that makes chips run more efficiently, thereby reducing operating costs. Another solution is that Google and Microsoft can display links to ads in chatbot replies, which will generate revenue that offsets the cost of running the servers.
Another option that ChatGPT has been implementing; provide a subscription service where users can get faster and better chatbot answers. That option can be a last resort for companies like Google and Microsoft. As more and more users access these new AI-driven search services, they will have to figure out if costs can be reduced enough to achieve economic returns.
You should read it
- 9 key differences between ChatGPT and Bing's AI Chatbot
- Is ChatGPT Plus or Perplexity the better AI chatbot?
- Google's AI chatbot for medical support has been tested in hospitals
- Baidu launches Ernie Bot, ChatGPT's rival chatbot
- 4 ways AI Claude chatbot outperforms ChatGPT
- Samsung may launch ChatGPT-competitive AI chatbot later this year
- 5 things users should avoid asking AI chatbots
- The line between ChatGPT and Bing Chat is getting blurred
May be interested
- Search for what when Google 'sudden death'?although the incident with google yesterday was just a 'one-year-old' affair, but it shows that this is not necessarily a perfect machine and there are still potential risks. . meanwhile, a search engine to replace google will be what people need, especially when most internet users are too dependent on search engines like today.
- Google will offer AI-powered search features for a feeaccording to a report by financial times, google, the online search technology giant may be considering changing its business model by offering premium, ai-powered features in google search with a shipping fee.
- How to turn off search suggestions in Microsoft Edgewith the new microsoft edge, when you start typing a search query in the address bar, you'll get suggestions from your default search engine. if you don't want to see those things anymore, here's how to turn them off.
- Microsoft Sorrow: Google is the most popular search term on Bingnearly a decade ago, there was a comment that bing was an 'addict' that consumed billions of dollars a year of microsoft. but it is also a strategic weapon for the software giant to use in the search service war, with the tireless goal of bringing down google.
- Search engines may not know you yetsearch engines like google and bing have become very familiar and popular. but regular search engines only scan the 'surface' of the internet. to dive into the 'nooks and crows' of the internet, you need to use special search engines.
- Interesting search engines on Google that you may not know yetgoogle is the most popular search engine on the internet today, which everyone knows, but many people don't realize there are still many interesting things that we can exploit on this great search engine.
- Google Search Android encounters strange errors, automatically escaping when users search for these keyword phrasesthe google search app for android has just encountered a 'bad cry and laugh' error.
- Google announced a major change in search functionalitygoogle's search engine (google search) accounts for a large part of the lives of those who use the internet to the point that 'google' becomes a verb for finding something.
- Private search engines replace Googlegoogle is now a popular search engine globally. and when you search for any information on google that will be saved, or when you use google services like gmail, google drive, ... personal information will also be tracked.
- This is the most effective way to search on googledo you know how to use the best google search engine today? with just a few simple tips, you will get the best results when using this search system.