Tweet

Does Moore's Law Suddenly Matter Less?

Guest post by: Brad Feld

Article Overview: A post in the New York Times this morning asserted that Software Progress Beats Moore’s Law. It’s a short post, but the money quote is from Ed Lazowska at the University of Washington:

Does Moore's Law Suddenly Matter Less?

A post in the New York Times this morning asserted that Software Progress Beats Moore's Law. It's a short post, but the money quote is from Ed Lazowska at the University of Washington: "The rate of change in hardware captured by Moore's Law, experts agree, is an extraordinary achievement. "But the ingenuity that computer scientists have put into algorithms have yielded performance improvements that make even the exponential gains of Moore's Law look trivial," said Edward Lazowska, a professor at the University of Washington.

The rapid pace of software progress, Mr. Lazowska added, is harder to measure in algorithms performing nonnumerical tasks. But he points to the progress of recent years in artificial intelligence fields like language understanding, speech recognition and computer vision as evidence that the story of the algorithm's ascent holds true well beyond more easily quantified benchmark tests."

If you agree with this, the implications are profound. Watching Watson kick Ken Jennings ass in Jeopardy a few weeks ago definitely felt like a win for software, but someone (I can't remember who) had the fun line that "it still took a data center to beat Ken Jennings."

While that doesn't really matter because Moore's Law will continue to apply to the data center, but my hypothesis is that there's a much faster rate of advancement on the software layer. And if this is true it has broad impacts for computing, and computing enabled society, as a whole. It's easy to forget about the software layer, but as an investor I live in it. As a result of several of our themes, namely HCI and Glue, we see first hand the dramatic pace at which software can improve.

I've been through my share of 100x to 1000x performance improvements because of a couple of lines of code or a change in the database structure in my life as a programmer 20+ years ago. At the time the hardware infrastructure was still the ultimate constraint - you could get linear progress by throwing more hardware at the problem. The initial software gains happened quickly but then you were stuck with the hardware improvements. If don't believe me, go buy a 286 PC and a 386 PC on eBay, load up dBase 3 on each, and reindex some large database files. Now do the same with FoxPro on each. The numbers will startle you.

It feels very different today. The hardware is rapidly becoming an abstraction in a lot of cases. The web services dynamic - where we access things through a browser - built a UI layer in front of the hardware infrastructure. Our friend the cloud is making this an even more dramatic separation as hardware resources become elastic, dynamic, and much easier for the software layer folks to deploy and use. And, as a result, there's a different type of activity on the software layer.

I don't have a good answer as to whether it's core algorithms, distributed processing across commodity hardware (instead of dedicated Connection Machines), new structural approaches (e.g. NoSql), or just the compounding of years of computer science and software engineering, but I think we are at the cusp of a profound shift in overall system performance and this article pokes us nicely in the eye to make sure we are aware of it.

The robots are coming. And they will be really smart. And fast. Let's hope they want to be our friends.

Read this article in Brad's blog.

Related Articles
  BANG BANG YOU’RE DEAD!
  2 Ways To Create Fresh Content For Your Website
  Michael Moore – an evangelist for truth
  Why You Must Master Self-Discpline
  The Underwater Mortgage and the Cash-Strapped Homeowner
  How A Game Of Rugby League Can Teach You To Make Your Online Business A Success.
  Don't Take Your Life For Granted
  Planning for the Unthinkable
  How To Choose Your Beliefs
  Why Sizzling Hot Prospects Suddenly Go Stone Cold…And What to Do About it!
  How To Disaster-Proof Your Business
  Preparation Is The Key
  Pushing Past Procrastination - The Revelation
  Time Management: Watch Out For The ‘Squirrels’ in Your Day!
  When Bad Things Happen to Good Business Owners and Entrepreneurs
  Rising Fom Disappointment
  Time To Go? Are You Going To Be Sacked Or Made Redundant?
  How A Business Mentor Works With An Entrepreneur
  When in doubt, disaggregate
  Those "Instant" Successes

Article Tags: ed lazowska, money, new york times, software progress, university of washington



Related Forum Posts
Funnies - Hi here, Johnny was going to do the christmas shopping. After clutching for the car keys, he was looking for his reading glasses. "Where are they?" I can't find them anywhere. "Anybody can help me?" Suddenly the mother shouted: "You are wearing them right now!" "Oh thanks, they are so light, I don't feel I got them on." Regards Beat
Re: Affiliate Marketing - Open for Discussion - I have had some eye-opening or eyebrow-raising affiliate marketing experiences in the last few months... Like, how is it that my biggest commission ever came from a company that I do very little to actively promote since the time when I set up a web page and a squidoo lense plus added a few links to my website??? And then there is the case of the hosting company that is not my main web hosting recommendation, but they sent me a Paypal payment out of the blue the other month... I think I "promote" them on one page of my website... Compared to those there are products that I have talked up and promoted much more actively that people just don't seem to go for... Set-it-and-forget-it seems to work better for me than flog-it-like-crazy! It is the same whenever I go away on holiday and don't touch my websites for two or three weeks together. Suddenly people come out of the woodwork to buy stuff that has not had any sales for months or even years on end. Is it voodoo or what?


Share this article with your friends. Fund someone's dream.

Leave a comment below or share on the left and you'll help support entrepreneurs in Africa through our partnership with Kiva. Over $50,000 raised and counting - Please keep sharing! Learn more.

Newsletter

Get advice & tips from famous business
owners, new articles by entrepreneur
experts, my latest website updates, &
special sneak peaks at what's to come!

Name:
Email:

Popular Articles

3 Health Insurance Misconceptions

Why We MUST Reinvent The Wheel

Web Design in 30 Minutes - Can this be Right?

Suggestions

Email us your ideas on how to make our
website more valuable! Thank you Sharon
from Toronto Salsa Lessons / Classes for
your suggestions to make the newsletter
look like the website and profile younger
entrepreneurs like Jennifer Lopez.