The Computational Limits of Deep Learning

This is an interesting paper published recently. Before we rush headlong in adoption of new technology, we must understand its inherent limitations.

Deep learning’s recent history has been one of achievement: from triumphing over humans in the game of Go to world-leading performance in image recognition, voice recognition, translation, and other tasks.

But this progress has come with a voracious appetite for computing power.

This article reports on the computational demands of Deep Learning applications in five prominent application areas and shows that progress in all five is strongly reliant on increases in computing power.

Extrapolating forward this reliance reveals that progress along current lines is rapidly becoming economically, technically, and environmentally unsustainable. Thus, continued progress in these applications will require dramatically more computationally-efficient methods, which will either have to come from changes to deep learning or from moving to other machine learning methods.

[2007.05558] The Computational Limits of Deep Learning
[embeddoc url=”” download=”none” viewer=”google”]

Here’s the summary:

[embeddoc url=”” download=”all” viewer=”microsoft”]

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.