Nvidia Declares That It Is A Full-Stack Platform – The Next Platform
In a decade and a half, Nvidia has come a long way from its early days as a provider of graphics chips for personal computers and other consumer devices.
Jensen Huang, Nvidia co-founder and chief executive officer, put his sights on the datacenter, pushing GPUs as a way of accelerating HPC applications and the CUDA software development environment as a way of making that happen. Five years later, Huang declared artificial intelligencethe future of computing and that Nvidia would not only enable that, but bet the company on this being the future of software development that AI-enhanced everything would be, in fact, the next platform.
The company has continued to evolve, expanding its hardware and software capabilities aimed at meeting the demands of an ever-changing IT landscape that now includes multiple clouds and the fast-growing edge and, Huang expects, a virtual world of digital twins and avatars, and all of this dependent on the companys technologies.
Nvidia has not been a point product provider for some time, but is now a full-stack platform vendor for this new computing world.
Accelerated computing starts with Nvidia CUDA general-purpose programmable GPUs, Huang said during his keynote address at the companys virtual GTC 2021 event this week. The magic of accelerated computing comes from the combination of CUDA, the acceleration libraries of algorithms that speed-up applications and the distributed computing systems and software that scale processing across an entire datacenter.
Nvidia has been advancing CUDA and expanding the surrounding ecosystem for it for more than fifteen years.
We optimize across the full stack, iterating between GPU, acceleration libraries, systems, and applications continuously, all the while expanding the reach of our platform by adding new application domains that we accelerate, he said. With our approach, end users experience speedups through the life of the product. It is not unusual for us to increase application performance by many X-factors on the same chip over several years. As we accelerate more applications, our network of partners see growing demand for Nvidia platforms. Starting from computer graphics, the reach of our architecture has reached deep into the worlds largest industries. We start with amazing chips, but for each field of science, industry and application, we create a full stack.
To illustrate that, Huang pointed to the more than 150 software development kits that target a broad range of industries, from design to life sciences, and at GTC announced 65 new or updated SDKs touching on such areas as quantum computing, cybersecurity, and robotics. The number of developers using Nvidia technologies has grown to almost three million, increasing six-fold over the past five years. In addition, CUDA has been downloaded 30 million times over 15 years, including seven million times last year.
Our expertise in full-stack acceleration and datacenter-scale architectures lets us help researchers and developers solve problems at the largest scales, he said. Our approach to computing is highly energy-efficient. The versatility of architecture lets us contribute to fields ranging from AI to quantum physics to digital biology to climate science.
That said, Nvidia is not without its challenges. The companys $40 billion bid for Arm is no sure thing, with regulators from the UK and Europe saying they want to take a deeper look at the possible market impacts the deal would create and Qualcomm leading opposition to the proposed acquisition. In addition, the competition in GPU-accelerated computing is heating up, with AMD advancing its capabilities we recently wrote about the companys Aldebaran Instinct MI200 GPU accelerator and Intel last week saying that it expects the upcoming Aurora supercomputer will scale beyond 2 exaflops due in large part to a better-than-expected performance by its Ponte Vecchio Xe HPC GPUs.
Still, Nvidia sees its future in creating the accelerated-computing foundation for the expansion of AI, machine learning and deep learning into a broad array of industries, as illustrated by the usual avalanche of announcements coming out of GTC. Among the new libraries was ReOpt, which is aimed finding the shortest and most efficient routes for getting products and services to their destinations, which can save companies time and money in last-mile delivery efforts.
CuQuantum is another library for creating quantum simulators to validate research in the field while the industry builds the first useful quantum computers. Nvidia has built a cuQuantum DGX appliance for speeding up quantum circuit simulations, with the first accelerated quantum simulator coming to Googles Cirq framework coming in the first quarter 2022. Meanwhile, cuNumeric is aimed at accelerating NumPy workloads, scaling from one GPU to multi-node clusters.
Nvidias new Quantum-2 interconnect (which has nothing to do with quantum computing) is a 400 Gb/sec InfiniBand platform that comprises the Quantum-2 switch, the ConnectX-7 SmartNIC, the BlueField 3 DPU, and features like performance isolation, a telemetry-based congestion-control system and 32X higher in-switch processing for AI training. In addition, nanosecond timing will enable cloud datacenters to get into the telco space by hosting software-defined 5G radio services.
Quantum-2 is the first networking platform to offer the performance of a supercomputer and the shareability of cloud computing, Huang said. This has never been possible before. Until Quantum-2, you get either bare-metal high-performance or secure multi-tenancy. Never both. With Quantum-2, your valuable supercomputer will be cloud-native and far better utilized.
The 7 nanometer InfiniBand switch chip holds 57 billion transistors similar to Nvidias A100 GPU and has 64 ports running at 400 Gb/sec or 128 ports running at 200 Gb/sec. A Quantum-2 system can connect up to 2,048 ports, as compared to the 800 ports with Quantum-1. The switch is sampling now and comes with options for the ConnectX-7 SmartNIC sampling in January or BlueField 3 DPU, which will sample in May.
BlueField DOCA 1.2 is a suite of cybersecurity capabilities that Huang said will make BlueField an even more attractive platform for building a zero-trust architecture by offloading infrastructure software that is eating up as much as 30 percent of CPU capacity. In addition, Nvidias Morpheus deep-learning cybersecurity platform uses AI to monitor and analyze data from users, machines and services to detect anomalies and abnormal transactions.
Cloud computing and machine learning are driving a reinvention of the datacenter, Huang said. Container-based applications give hyperscalers incredible abilities to scale out, allowing millions to use their services concurrently. The ease of scale out and orchestration comes at a cost: east-west network traffic increased incredibly with machine-and-machine message passing and these disaggregated applications open many ports inside the datacenter that need to be secured from cyberattack.
Nvidia has bolstered its Triton Inferencing Server with new support for the Arm architecture; the system already supported Nvida GPUs and X86 chips from Intel and AMD. In addition, version 2.15 of Triton also can run multiple GPU and multi-node inference workloads, which Huang called arguably one of the most technically challenging runtime engines the world has ever seen.
As these models are growing exponentially, particularly in new use cases, theyre often getting too big for you to run on a single CPU or even a single server, Ian Buck, vice president and general manager of Nvidias Tesla datacenter business, said during a briefing with journalists. Yet the demands [and] the opportunities for these large models want to be delivered in real time. The new version of Triton actually supports distributed inference. We take the model and we split it across multiple GPUs and multiple servers to deliver that to optimize the computing to deliver the fastest possible performance of these incredibly large models.
Nvidia also unveiled NeMo Megatron, a framework for training large language models (LLMs) that have trillions of parameters. NeMo Megatron can be used for such jobs as language translation and compute program writing, and it leverages the Triton Inference Server. Nvidia last month unveiled Megatron 530B, a language mode with 530 billion parameters.
The recent breakthrough of large language models is one of the great achievements in computer science, Huang said. Theres exciting work being done in self-supervised multi-modal learning and models that can do tasks that it was never trained on called zero-shot learning. Ten new models were announced last year alone. Training LLMs is not for the faint of heart. Hundred-million-dollar systems, training trillion-parameter models on petabytes of data for months requires conviction, deep expertise, and an optimized stack.
A lot of time at the event was spent on Nvidias Omniverse platform, the virtual environment introduced last year that the company believes will be a critical enterprise tool in the future. Skeptics point to avatars and the like in suggesting that Omniverse is little more than a second coming of Second Life. In responding to a question, Buck said there are two areas where Omniverse is catching on in the enterprise.
The first is digital twins virtual representations of machines or systems that recreate an environment like the work were doing in embedded and robotics and other places to be able to simulate virtual worlds, actually simulate the products that are being built in a virtual environment and be able to prototype them entirely with Omniverse. A virtual setting allows the product development to happen in a way that has been before remotely, virtually around the world.
The other is in the commercial use of virtual agents this is where the AI-based avatars can come in to help with call centers and similar customer-facing tasks.
See the original post here:
Nvidia Declares That It Is A Full-Stack Platform - The Next Platform
- Quantum Computing - Why BTC isn't the biggest worry for COINBASE:BTCUSD by Profit_Through_Patience - TradingView - July 10th, 2025 [July 10th, 2025]
- 3 Artificial Intelligence (AI) Stocks Could Lead the Quantum Computing Revolution - The Motley Fool - July 10th, 2025 [July 10th, 2025]
- D-Wave, Yonsei, Incheon team up to boost quantum computing - Evertiq - July 10th, 2025 [July 10th, 2025]
- Is Rigetti Computing the Top Quantum Computing Stock for the Second Half of 2025? - The Motley Fool - July 10th, 2025 [July 10th, 2025]
- Why Quantum Computing Stock Skyrocketed 69.3% in June -- and What Comes Next? - The Motley Fool - July 10th, 2025 [July 10th, 2025]
- SuperQ Quantum Computing Inc. to Begin Trading on CSE as QBTQ - TipRanks - July 10th, 2025 [July 10th, 2025]
- Why Quantum Computing Stock Skyrocketed 69.3% in June -- and What Comes Next? - AOL.com - July 10th, 2025 [July 10th, 2025]
- This Quantum Computing Stock Just Raised $1 Billion And Analyst Says Its Only Getting Started - IonQ (NYSE:IONQ) - Benzinga - July 10th, 2025 [July 10th, 2025]
- Nearly two-thirds of organizations consider quantum computing as the most critical cybersecurity threat in 3-5 years - The Manila Times - July 10th, 2025 [July 10th, 2025]
- Quantum Computing (NASDAQ:QUBT) Shares Down 2.2% - Here's What Happened - MarketBeat - July 10th, 2025 [July 10th, 2025]
- Billionaires Are Buying This Quantum Computing Stock Hand Over Fist (Hint: It's Not IonQ or D-Wave Quantum) - The Motley Fool - July 8th, 2025 [July 8th, 2025]
- Individual defects in superconducting quantum circuits imaged for the first time - Scientific Computing World - July 8th, 2025 [July 8th, 2025]
- Horses for Courses: Where Quantum Computing Is, and Isnt, the Answer - RealClearDefense - July 8th, 2025 [July 8th, 2025]
- Satoshi-Era Bitcoin (BTC) Whale's $8B Move Explained Amid Looming Quantum Computing Threat to Crypto - Blockchain News - July 8th, 2025 [July 8th, 2025]
- Quantum Computing's 'Q-Day' Threat: Is Your Bitcoin (BTC) and Ethereum (ETH) Portfolio Facing Annihilation? - Blockchain News - July 8th, 2025 [July 8th, 2025]
- BlackRock's Bitcoin ETF Filing Warns of Quantum Computing Threat: Could Q-Day Make BTC and ETH Worthless? - Blockchain News - July 8th, 2025 [July 8th, 2025]
- Quantum Computing's "Q-Day" Poses Existential Risk to Bitcoin (BTC) and Ethereum (ETH), Expert Warns - Blockchain News - July 8th, 2025 [July 8th, 2025]
- Quantum Computing Threat: 25% of Bitcoin (BTC) at Risk as Polyhedra (ZKJ) Crashes 80% After Liquidity Attack - Blockchain News - July 8th, 2025 [July 8th, 2025]
- Scientists Just Simulated the Impossible in Quantum Computing - SciTechDaily - July 8th, 2025 [July 8th, 2025]
- 3 Quantum Computing Stocks with Potential to Beat the Market 7/7/2025 - TipRanks - July 8th, 2025 [July 8th, 2025]
- JPMorgan's quantum computing team lost its leaders & there is a mystery - eFinancialCareers - July 8th, 2025 [July 8th, 2025]
- Cracking the quantum code: Light and glass are set to transform computing - Phys.org - July 8th, 2025 [July 8th, 2025]
- IBM Backs $26M Funding for Quantum Computing Error Correction Startup - IoT World Today - July 8th, 2025 [July 8th, 2025]
- Horses for courses: where quantum computing is, and isnt, the answer - The Strategist | ASPI's analysis and commentary site - July 8th, 2025 [July 8th, 2025]
- D-Wave and Rigetti: Cantor Chooses the Best Quantum Computing Stocks to Buy - Yahoo Finance - July 6th, 2025 [July 6th, 2025]
- Quantum Computing's Surge: Navigating Tariffs and Tech Tailwinds for Profitable Growth - AInvest - July 6th, 2025 [July 6th, 2025]
- 2 Top Quantum Computing Stocks to Buy in July - The Motley Fool - July 6th, 2025 [July 6th, 2025]
- D-Wave and Rigetti: Cantor Chooses the Best Quantum Computing Stocks to Buy - TipRanks - July 4th, 2025 [July 4th, 2025]
- QEDMA Raises $26 Million With Participation From IBM to Tackle Quantum Computing Errors - The Quantum Insider - July 4th, 2025 [July 4th, 2025]
- Quantum Computing Stocks QBTS and IONQ Rally as Cantor Assigns Buy Rating - TipRanks - July 4th, 2025 [July 4th, 2025]
- Meet the Monster Quantum Computing Stock That Continues to Crush IonQ, Rigetti Computing, and Nvidia - The Motley Fool - July 4th, 2025 [July 4th, 2025]
- Meet the Monster Quantum Computing Stock That Continues to Crush IonQ, Rigetti Computing, and Nvidia - Nasdaq - July 4th, 2025 [July 4th, 2025]
- Rigetti Computing Is Skyrocketing Today -- Is the Quantum Computing Stock a Buy? - Yahoo Finance - July 4th, 2025 [July 4th, 2025]
- Why Quantum Computing Stock Skyrocketed Today - The Motley Fool - July 4th, 2025 [July 4th, 2025]
- The European Commission wants Europe to become the world leader in quantum computing within the next five years - PC Gamer - July 4th, 2025 [July 4th, 2025]
- Cracking the quantum code: light and glass are set to transform computing - research-and-innovation.ec.europa.eu - July 4th, 2025 [July 4th, 2025]
- Rigetti Computing Is Skyrocketing Today -- Is the Quantum Computing Stock a Buy? - The Motley Fool - July 4th, 2025 [July 4th, 2025]
- Quantum Computing Investments: A Once-in-a-Lifetime Opportunity? - Yahoo - July 4th, 2025 [July 4th, 2025]
- BlackRock Warns Quantum Computing Threatens Bitcoin Security - IoT World Today - July 4th, 2025 [July 4th, 2025]
- Rigetti Computing Is Skyrocketing Today -- Is the Quantum Computing Stock a Buy? - Nasdaq - July 4th, 2025 [July 4th, 2025]
- MegazoneCloud & Classiq Boost Quantum Computing In Korea - Quantum Zeitgeist - July 4th, 2025 [July 4th, 2025]
- Rigetti vs. D-Wave: Which Quantum Computing Stock Has Better Prospects? - Zacks Investment Research - July 2nd, 2025 [July 2nd, 2025]
- IonQ: The Next Disruptive Opportunity In Quantum Computing (NYSE:IONQ) - Seeking Alpha - July 2nd, 2025 [July 2nd, 2025]
- Rigetti vs. D-Wave: Which Quantum Computing Stock Has Better Prospects? - Yahoo Finance - July 2nd, 2025 [July 2nd, 2025]
- Terror-Linked Qataris Could Gain Quantum Computing Technology via Billion-Dollar Deal - Middle East Forum - July 2nd, 2025 [July 2nd, 2025]
- Quantum Computing Progress: Scaling Fidelity And Algorithms For Practical Advantage - Quantum Zeitgeist - July 2nd, 2025 [July 2nd, 2025]
- The Best Quantum Computing Stocks to Buy Right Now - The Motley Fool - July 2nd, 2025 [July 2nd, 2025]
- Quantum Computing Threat Drives New Encryption Standards and Mathematical Challenges. - Quantum Zeitgeist - July 2nd, 2025 [July 2nd, 2025]
- IBM's Quantum Leap: Can AI and Quantum Computing Drive a New Era of Growth? - AInvest - July 2nd, 2025 [July 2nd, 2025]
- Why IonQ Could Be the Quantum Computing Leader to Multiply Your Investment by 2035 - AInvest - July 2nd, 2025 [July 2nd, 2025]
- European Investment Fund Invests 30M ($35.1M USD) in Quantonation II for Quantum Technologies and Deep Physics - Quantum Computing Report - July 2nd, 2025 [July 2nd, 2025]
- 3 Quantum Computing Stocks That Could Deliver Decades of Explosive Growth - The Motley Fool - June 29th, 2025 [June 29th, 2025]
- QUANTUM COMPUTING INVESTIGATION INITIATED by Former Louisiana Attorney General: Kahn Swick & Foti, LLC Investigates the Officers and Directors of... - June 29th, 2025 [June 29th, 2025]
- KT and HEQA Security Partner to Deploy Quantum Key Distribution for Telecom Infrastructure - Quantum Computing Report - June 29th, 2025 [June 29th, 2025]
- Quantum computing on the horizon: What leaders need to know. - McKinsey & Company - June 28th, 2025 [June 28th, 2025]
- 1 Quantum Computing Stock That Is a Glaring Buy, According to Wall Street - Yahoo Finance - June 28th, 2025 [June 28th, 2025]
- 3 Quantum Computing Stocks on Verge of a Breakout: QBTS, IONQ, QUBT - Yahoo Finance - June 28th, 2025 [June 28th, 2025]
- Quantum Computing Achieves First Real-World Milestone in Image Recognition - ScienceBlog.com - June 28th, 2025 [June 28th, 2025]
- IonQ vs IBM: Which Quantum Computing Stock Is the Better Buy Today? - Yahoo Finance - June 28th, 2025 [June 28th, 2025]
- Want to Invest in Quantum Computing? 2 Stocks That Are Great Buys Right Now. - MSN - June 28th, 2025 [June 28th, 2025]
- 1 Quantum Computing Stock That Is a Glaring Buy, According to Wall Street - MSN - June 28th, 2025 [June 28th, 2025]
- 1 Quantum Computing Stock That Is a Glaring Buy, According to Wall Street - The Motley Fool - June 28th, 2025 [June 28th, 2025]
- Are Quantum Computing Stocks Becoming the Next AI? - The Motley Fool - June 28th, 2025 [June 28th, 2025]
- F.D. Flam: Quantum computing could be the future of drug development - Pioneer Press - June 28th, 2025 [June 28th, 2025]
- Quantum Computing Completes $200 Million Private Placement. Why the Stock Is Falling. - Barron's - June 28th, 2025 [June 28th, 2025]
- Want to Invest in Quantum Computing? 2 Stocks That Are Great Buys Right Now. - Yahoo Finance - June 28th, 2025 [June 28th, 2025]
- The Smartest Way to Play Quantum Computing May Already Be in Your Portfolio - The Motley Fool - June 24th, 2025 [June 24th, 2025]
- Quantum Computing News: New Roadmaps, Real Timelines, and Rising Stocks - TipRanks - June 24th, 2025 [June 24th, 2025]
- Will Quantum Computing Stocks Soar in the Second Half? - The Motley Fool - June 24th, 2025 [June 24th, 2025]
- 2 Quantum Computing Stocks That Could Become Monsters - The Motley Fool - June 24th, 2025 [June 24th, 2025]
- UK Government Commits 670 Million ($908.6 Million USD) Over 10 Years to Advance Quantum Computing Capabilities - Quantum Computing Report - June 24th, 2025 [June 24th, 2025]
- Is Quantum Computing (QUBT) Stock a Buy on This Bold Technological Breakthrough? - Yahoo Finance - June 24th, 2025 [June 24th, 2025]
- 2 Top Quantum Computing Stocks to Buy in 2025 - Yahoo Finance - June 24th, 2025 [June 24th, 2025]
- UK Commits 500 Million to Quantum Computing Amid Sovereignty And Security Concerns - The Quantum Insider - June 24th, 2025 [June 24th, 2025]
- Can Investing $10,000 in Quantum Computing (QUBT) Stock Turn Into $1 Million by 2035? - The Motley Fool - June 24th, 2025 [June 24th, 2025]
- SEALSQ, ColibriTD, and Xdigit Announce Plan to Develop a Breakthrough Quantum Computing Based Solution Set to Revolutionize Semiconductor Wafer Yields... - June 24th, 2025 [June 24th, 2025]
- Why Quantum Computing Stock Is Plummeting Today - The Globe and Mail - June 24th, 2025 [June 24th, 2025]
- AdvanThink and Quandela Partner to Explore Quantum AI for Payment Fraud Detection - Quantum Computing Report - June 22nd, 2025 [June 22nd, 2025]
- Fleet Space Advances Quantum-Enhanced Mineral Exploration with New Partnerships - Quantum Computing Report - June 22nd, 2025 [June 22nd, 2025]
- How Will Bitcoin Defend Against Quantum Computing? This Project Just Raised $6M - Decrypt - June 20th, 2025 [June 20th, 2025]