AI vs. Humans: Which Performs Certain Skills Better?
Raw Text
AI
Published
4 days ago
on
August 25, 2023
By
Mark Belan
Article/Editing:
Pallavi Rao
With ChatGPT’s explosive rise , AI has been making its presence felt for the masses, especially in traditional bastions of human capabilities—reading comprehension, speech recognition and image identification.
In fact, in the chart above it’s clear that AI has surpassed human performance in quite a few areas, and looks set to overtake humans elsewhere.
How Performance Gets Tested
Using data from Contextual AI , we visualize how quickly AI models have started to beat database benchmarks, as well as whether or not they’ve yet reached human levels of skill.
Each database is devised around a certain skill, like handwriting recognition, language understanding, or reading comprehension, while each percentage score contrasts with the following benchmarks:
0% or “maximally performing baseline” This is equal to the best-known performance by AI at the time of dataset creation.
100% This mark is equal to human performance on the dataset.
By creating a scale between these two points, the progress of AI models on each dataset could be tracked. Each point on a line signifies a best result and as the line trends upwards, AI models get closer and closer to matching human performance.
Below is a table of when AI started matching human performance across all eight skills:
A key observation from the chart is how much progress has been made since 2010 . In fact many of these databases—like SQuAD, GLUE, and HellaSwag—didn’t exist before 2015.
In response to benchmarks being rendered obsolete, some of the newer databases are constantly being updated with new and relevant data points. This is why AI models technically haven’t matched human performance in some areas (grade school math and code generation) yet—though they are well on their way.
What’s Led to AI Outperforming Humans?
But what has led to such speedy growth in AI’s abilities in the last few years?
Thanks to revolutions in computing power, data availability, and better algorithms, AI models are faster, have bigger datasets to learn from, and are optimized for efficiency compared to even a decade ago.
This is why headlines routinely talk about AI language models matching or beating human performance on standardized tests. In fact, a key problem for AI developers is that their models keep beating benchmark databases devised to test them, but still somehow fail real world tests .
Since further computing and algorithmic gains are expected in the next few years, this rapid progress is likely to continue. However, the next potential bottleneck to AI’s progress might not be AI itself, but a lack of data for models to train on.
*
Related Topics:
data consumption SuperGLUE chatgpt google OpenAI AI jobs amazon AI tests microsoft ai optimism cloud computing google bard artificial intelligence partner ai AI benchmark testing algorithms GLUE
Don't Miss Nvidia vs. AMD vs. Intel: Comparing AI Chip Sales
Click for Comments
You may also like
Nvidia vs. AMD vs. Intel: Comparing AI Chip Sales
The 50 Most Valuable Companies in the World in 2023
Lifetime VC+ Subscription – One-time Offer Expires Aug 24, 2023
Visualizing the $105 Trillion World Economy in One Chart
Ranked: The U.S. Cities with the Most Vacant Offices
Ranked: The Top 100 Brands by Value in 2023
AI
Nvidia vs. AMD vs. Intel: Comparing AI Chip Sales
The generative AI boom is powered by processors. How have AI chip sales grown over the last two years among Nvidia vs AMD vs Intel?
Published
5 days ago
on
August 25, 2023
By
Jenna Ross
Nvidia vs. AMD vs. Intel: Comparing AI Chip Sales
Nvidia has become an early winner of the generative AI boom.
The company reported record revenue in its second quarter earnings report, with sales of AI chips playing a large role. If we compare to other American competitors, what do the AI chip sales of Nvidia vs. AMD vs. Intel look like?
In this graphic, we use earnings reports from each company to see their revenue over time.
A Clear Leader Emerges
While the companies don’t report revenue for their AI chips specifically, they do share revenue for their Data Center segment.
The Data Center segment includes chips like Central Processing Units (CPUs), Data Processing Units (DPUs), and Graphic Processing Units (GPUs). The latter are preferred for AI because they can perform many simple tasks simultaneously and efficiently.
Below, we show how quarterly Data Center revenue has grown for Nvidia vs. AMD vs. Intel.
Source: Nvidia, AMD, Intel. Quarters are based on the calendar year. In cases where revenue was revised at a later date, we have used the latest available revision. Intel integrated its Accelerated Computing Systems & Graphics (AXG) group into its Data Center Group in 2023. We have included revenue from the AXG group in the Data Center revenue for quarters prior to 2023 except for Q1 and Q2 2022, where revised Data Center revenue was provided by Intel.
Nvidia’s Data Center revenue has quadrupled over the last two years, and it’s estimated to have more than 70% of the market share for AI chips.
The company achieved dominance by recognizing the AI trend early, becoming a one-stop shop offering chips, software, and access to specialized computers. After hitting a $1 trillion market cap earlier in 2023, the stock continues to soar.
Competition Between Nvidia vs. AMD vs. Intel
If we compare Nvidia vs. AMD, the latter company has seen slower growth and less revenue. Its MI250 chip was found to be 80% as fast as Nvidia’s A100 chip.
However, AMD has recently put a focus on AI, announcing a new MI300X chip with 192GB of memory compared to the 141GB that Nvidia’s new GH200 offers. More memory reduces the amount of GPUs needed, and could make AMD a stronger contender in the space.
In contrast, Intel has seen yearly revenue declines and has virtually no market share in AI chips. The company is better known for making traditional CPUs, and its foray into the AI space has been fraught with issues. Its Sapphire Rapids processor faced years of delays due to a complex design and numerous glitches.
Going forward, all three companies have indicated they plan to increase their AI offerings. It’s not hard to see why: ChatGPT reportedly runs on 10,000 Nvidia A100 chips, which would carry a total price tag of around $100 million dollars .
As more AI models are developed, the infrastructure that powers them will be a huge revenue opportunity.
Continue Reading
Subscribe
*
Popular
Mining 4 weeks ago Charted: America’s Import Reliance of Key Minerals
Markets 2 weeks ago Charted: The Rise and Fall of WeWork
United States 3 weeks ago Internet Adoption in America: Who Isn’t Online Yet?
Technology 2 weeks ago The Most-Viewed YouTube Videos of All Time
United States 3 weeks ago Where are Immigrant Founders of U.S. Unicorns From?
Money 2 weeks ago Visualizing $156 Trillion in U.S. Assets, by Generation
GDP 3 weeks ago Visualizing the $105 Trillion World Economy in One Chart
Markets 1 week ago The 50 Most Valuable Companies in the World in 2023
Single Line Text
AI. Published. 4 days ago. on. August 25, 2023. By. Mark Belan. Article/Editing: Pallavi Rao. Twitter. Facebook. LinkedIn. Reddit. Pinterest. Email. With ChatGPT’s explosive rise , AI has been making its presence felt for the masses, especially in traditional bastions of human capabilities—reading comprehension, speech recognition and image identification. In fact, in the chart above it’s clear that AI has surpassed human performance in quite a few areas, and looks set to overtake humans elsewhere. How Performance Gets Tested. Using data from Contextual AI , we visualize how quickly AI models have started to beat database benchmarks, as well as whether or not they’ve yet reached human levels of skill. Each database is devised around a certain skill, like handwriting recognition, language understanding, or reading comprehension, while each percentage score contrasts with the following benchmarks: 0% or “maximally performing baseline” This is equal to the best-known performance by AI at the time of dataset creation. 100% This mark is equal to human performance on the dataset. By creating a scale between these two points, the progress of AI models on each dataset could be tracked. Each point on a line signifies a best result and as the line trends upwards, AI models get closer and closer to matching human performance. Below is a table of when AI started matching human performance across all eight skills: A key observation from the chart is how much progress has been made since 2010 . In fact many of these databases—like SQuAD, GLUE, and HellaSwag—didn’t exist before 2015. In response to benchmarks being rendered obsolete, some of the newer databases are constantly being updated with new and relevant data points. This is why AI models technically haven’t matched human performance in some areas (grade school math and code generation) yet—though they are well on their way. What’s Led to AI Outperforming Humans? But what has led to such speedy growth in AI’s abilities in the last few years? Thanks to revolutions in computing power, data availability, and better algorithms, AI models are faster, have bigger datasets to learn from, and are optimized for efficiency compared to even a decade ago. This is why headlines routinely talk about AI language models matching or beating human performance on standardized tests. In fact, a key problem for AI developers is that their models keep beating benchmark databases devised to test them, but still somehow fail real world tests . Since further computing and algorithmic gains are expected in the next few years, this rapid progress is likely to continue. However, the next potential bottleneck to AI’s progress might not be AI itself, but a lack of data for models to train on. * Related Topics: data consumption SuperGLUE chatgpt google OpenAI AI jobs amazon AI tests microsoft ai optimism cloud computing google bard artificial intelligence partner ai AI benchmark testing algorithms GLUE. Don't Miss Nvidia vs. AMD vs. Intel: Comparing AI Chip Sales. Click for Comments. You may also like. Nvidia vs. AMD vs. Intel: Comparing AI Chip Sales. The 50 Most Valuable Companies in the World in 2023. Lifetime VC+ Subscription – One-time Offer Expires Aug 24, 2023. Visualizing the $105 Trillion World Economy in One Chart. Ranked: The U.S. Cities with the Most Vacant Offices. Ranked: The Top 100 Brands by Value in 2023. AI. Nvidia vs. AMD vs. Intel: Comparing AI Chip Sales. The generative AI boom is powered by processors. How have AI chip sales grown over the last two years among Nvidia vs AMD vs Intel? Published. 5 days ago. on. August 25, 2023. By. Jenna Ross. Nvidia vs. AMD vs. Intel: Comparing AI Chip Sales. Nvidia has become an early winner of the generative AI boom. The company reported record revenue in its second quarter earnings report, with sales of AI chips playing a large role. If we compare to other American competitors, what do the AI chip sales of Nvidia vs. AMD vs. Intel look like? In this graphic, we use earnings reports from each company to see their revenue over time. A Clear Leader Emerges. While the companies don’t report revenue for their AI chips specifically, they do share revenue for their Data Center segment. The Data Center segment includes chips like Central Processing Units (CPUs), Data Processing Units (DPUs), and Graphic Processing Units (GPUs). The latter are preferred for AI because they can perform many simple tasks simultaneously and efficiently. Below, we show how quarterly Data Center revenue has grown for Nvidia vs. AMD vs. Intel. Source: Nvidia, AMD, Intel. Quarters are based on the calendar year. In cases where revenue was revised at a later date, we have used the latest available revision. Intel integrated its Accelerated Computing Systems & Graphics (AXG) group into its Data Center Group in 2023. We have included revenue from the AXG group in the Data Center revenue for quarters prior to 2023 except for Q1 and Q2 2022, where revised Data Center revenue was provided by Intel. Nvidia’s Data Center revenue has quadrupled over the last two years, and it’s estimated to have more than 70% of the market share for AI chips. The company achieved dominance by recognizing the AI trend early, becoming a one-stop shop offering chips, software, and access to specialized computers. After hitting a $1 trillion market cap earlier in 2023, the stock continues to soar. Competition Between Nvidia vs. AMD vs. Intel. If we compare Nvidia vs. AMD, the latter company has seen slower growth and less revenue. Its MI250 chip was found to be 80% as fast as Nvidia’s A100 chip. However, AMD has recently put a focus on AI, announcing a new MI300X chip with 192GB of memory compared to the 141GB that Nvidia’s new GH200 offers. More memory reduces the amount of GPUs needed, and could make AMD a stronger contender in the space. In contrast, Intel has seen yearly revenue declines and has virtually no market share in AI chips. The company is better known for making traditional CPUs, and its foray into the AI space has been fraught with issues. Its Sapphire Rapids processor faced years of delays due to a complex design and numerous glitches. Going forward, all three companies have indicated they plan to increase their AI offerings. It’s not hard to see why: ChatGPT reportedly runs on 10,000 Nvidia A100 chips, which would carry a total price tag of around $100 million dollars . As more AI models are developed, the infrastructure that powers them will be a huge revenue opportunity. Continue Reading. Subscribe. * Popular. Mining 4 weeks ago Charted: America’s Import Reliance of Key Minerals. Markets 2 weeks ago Charted: The Rise and Fall of WeWork. United States 3 weeks ago Internet Adoption in America: Who Isn’t Online Yet? Technology 2 weeks ago The Most-Viewed YouTube Videos of All Time. United States 3 weeks ago Where are Immigrant Founders of U.S. Unicorns From? Money 2 weeks ago Visualizing $156 Trillion in U.S. Assets, by Generation. GDP 3 weeks ago Visualizing the $105 Trillion World Economy in One Chart. Markets 1 week ago The 50 Most Valuable Companies in the World in 2023.