altReboot
  • Startup
  • Growth Hacking
  • Marketing
  • Automation
  • Blockchain Tech
  • Artificial Intelligence
  • Contact
    • Write For Us
No Result
View All Result
  • Startup
  • Growth Hacking
  • Marketing
  • Automation
  • Blockchain Tech
  • Artificial Intelligence
  • Contact
    • Write For Us
No Result
View All Result
altReboot
No Result
View All Result
Home Artificial Intelligence

The computing power needed to train AI is now rising seven times faster than ever before

Guest Author by Guest Author
November 11, 2019
in Artificial Intelligence
The computing power needed to train AI is now rising seven times faster than ever before
1
SHARES
7
VIEWS
Share on FacebookShare on Twitter

This post originally appeared on MIT Technology Review

Sign up for The Algorithm — artificial intelligence, demystified

In 2018, OpenAI found that the amount of computational power used to train the largest AI models had doubled every 3.4 months since 2012.

The San Francisco-based for-profit AI research lab has now added new data to its analysis. This shows how the post-2012 doubling compares to the historic doubling time since the beginning of the field. From 1959 to 2012, the amount of power required doubled every 2 years, following Moore’s Law. This means the doubling time today is more than seven times the previous rate.

Related articles

Public policies in the age of digital disruption

AIs that read sentences can also spot virus mutations

January 14, 2021
These five AI developments will shape 2021 and beyond

These five AI developments will shape 2021 and beyond

January 14, 2021

OpenAI

This dramatic increase in the resources needed underscores just how costly the field’s achievements have become. Keep in mind, the above graph shows a log scale. On a linear scale (below), you can more clearly see how compute usage has increased by 300,000-fold in the last seven years.

The chart also notably does not include some of the most recent breakthroughs, including Google’s large-scale language model BERT, OpenAI’s large-scale language model GPT-2,  or DeepMind’s StarCraft II-playing model AlphaStar.

OpenAI

In the past year, more and more researchers have sounded the alarm on the exploding costs of deep learning. In June, an analysis from researchers at the University of Massachusetts, Amherst, showed how these increasing computational costs directly translate into carbon emissions.

In their paper, they also noted how the trend exacerbates the privatization of AI research because it undermines the ability for academic labs to compete with much more resource-rich private ones.

In response to this growing concern, several industry groups have made recommendations. The Allen Institute for Artificial Intelligence, a nonprofit research firm in Seattle, has proposed that researchers always publish the financial and computational costs of training their models along with their performance results, for example.

In its own blog, OpenAI suggested policymakers increase funding to academic researchers to bridge the resource gap between academic and industry labs.

ShareTweet

Related Posts

Public policies in the age of digital disruption

AIs that read sentences can also spot virus mutations

by Will Heaven
January 14, 2021
0

Galileo once observed that nature is written in math. Biology might be written in words. Natural language processing (NLP) algorithms...

These five AI developments will shape 2021 and beyond

These five AI developments will shape 2021 and beyond

by Jason Sparapani
January 14, 2021
0

The year 2020 was profoundly challenging for citizens, companies, and governments around the world. As covid-19 spread, requiring far-reaching health...

Public policies in the age of digital disruption

Five ways to make AI a greater force for good in 2021

by Karen Hao
January 8, 2021
0

A year ago, none the wiser about what 2020 would bring, I reflected on the pivotal moment that the AI...

Public policies in the age of digital disruption

What Buddhism can do for AI ethics

by Amy Nordrum
January 6, 2021
0

The explosive growth of artificial intelligence has fostered hope that it will help us solve many of the world’s most...

Public policies in the age of digital disruption

We tested a tool to confuse Google’s ad network. It works and you should use it.

by Konstantin Kakaes
January 6, 2021
0

We’ve all been there by now: surfing the web and bumping into ads with an uncanny flavor. How did they...

Load More
  • Trending
  • Comments
  • Latest
7 Advanced SEO Strategies I’m Trying to Implement Before 2020

7 Advanced SEO Strategies I’m Trying to Implement Before 2020

September 10, 2019
What Do Successful Sales Look Like for the Rest of 2020?

13 Expert Tips to Increase Online Conversions in 2020

September 26, 2020
Creating SEO-friendly how-to content

Creating SEO-friendly how-to content

October 24, 2019
8 Simple Steps to Use Your Book to Grow Your Business

8 Simple Steps to Use Your Book to Grow Your Business

September 10, 2019
A Beginner’s Guide to Facebook Insights

A Beginner’s Guide to Facebook Insights

0

Which Social Media Sites Really Matter and Why

0
The 12 Ironclad Rules for Issuing Press Releases

The 12 Ironclad Rules for Issuing Press Releases

0
How to Get Started Building Links for SEO

How to Get Started Building Links for SEO

0

15 Ways to Use Voice Tweets

January 19, 2021
Avoid the Costly Mistake of Assembling the Wrong Leadership Team

Avoid the Costly Mistake of Assembling the Wrong Leadership Team

January 19, 2021
How to Make an App When You Can't Code (a Step-by-Step Guide)

When to Take Your Freelance Business Full-Time

January 19, 2021
How to Write Headlines People Can’t Help but Click [Formulas Inside]

How to Write Headlines People Can’t Help but Click [Formulas Inside]

January 19, 2021
altReboot




altREBOOT is committed to sharing the game changing advancements that are revolutionizing how you do business. From startup to goliath, innovations in technology are changing the face of the business landscape. We are committed to exploring these and how to apply them to your business at any stage of development.





Categories

  • Artificial Intelligence
  • Blockchain Tech
  • Growth Hacking
  • Marketing
  • Startup
  • Uncategorized

Tags

blockchain branding guest post marketing mobile apps
  • Home
  • Topics
  • Write For Us
  • Privacy Policy
  • Contact

Powered By Treehouse 51

No Result
View All Result
  • Startup
  • Growth Hacking
  • Marketing
  • Automation
  • Blockchain Tech
  • Artificial Intelligence
  • Contact
    • Write For Us