Wednesday, February 28, 2024
ad
HomeNewsChatGPT Costs a Whopping $700,000/Day to Operate, Says Research

ChatGPT Costs a Whopping $700,000/Day to Operate, Says Research

The cost per query in ChatGPT is estimated to be roughly 0.36 cents.

An investigation from SemiAnalysis’ revealed that OpenAI spends as much as $694,444 in actual money per day to maintain the chatbot. The system is believed to have 3,617 HGX A100 servers with 28,936 GPUs, according to the company’s estimation. The cost per query is estimated to be roughly 0.36 cents.

The current costs to run the programme could be considerably higher, according to Dylan Patel, Chief Analyst at SemiAnalysis, who said that GPT-4 is probably even more expensive to run than GPT-3. Although OpenAI has already made a GPT-4 version available to paying customers, Patel based his predictions on the outdated GPT-3 model.

According to the manufacturer, the new model provides more precise information and gives stronger protection against the remarks that veered off course and were an issue with GPT-3/3.5. The system’s power-guzzling specialized chips are one of the main causes of the high expenses. 

Read More: How Students Can Make The Best Use Of Technology To Enhance Learning Capacities

As a solution, Microsoft, one of the largest OpenAI stockholders, is rumored to be developing its own artificial intelligence (AI) processor, code-named Athena, which may completely replace the NVIDIA GPUs and significantly lower ChatGPT’s operating expenses.

ChatGPT can also create working code from scratch, sparking concerns that it might eventually overtake programmers. The code produced by the chatbot, however, could not be very secure, according to new research by computer scientists Raphael Khoury, Anderson Avila, Jacob Brunelle, and Baba Mamadou Camara.

Subscribe to our newsletter

Subscribe and never miss out on such trending AI-related articles.

We will never sell your data

Join our WhatsApp Channel and Discord Server to be a part of an engaging community.

Sahil Pawar
Sahil Pawar
I am a graduate with a bachelor's degree in statistics, mathematics, and physics. I have been working as a content writer for almost 3 years and have written for a plethora of domains. Besides, I have a vested interest in fashion and music.

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Most Popular