Datacenter Trends

Nvidia Touts Its 'Accelerated Computing' Vision for AI

The GPU maker has unveiled the CUDA-X AI, its latest technology to advance artificial intelligence in the datacenter.

Nvidia's 10th annual GPU Technology Conference, underway this week in San Jose, Calif., kicked off with a flashy video underscoring the company's artificial intelligence (AI) strategy, and CEO Jensen Huang fairly gushed about his company's new CUDA-X AI data science acceleration software.

Server acceleration, he said, is becoming a standard to boost AI in the datacenter.

"Accelerated computing is not just about the chips," Huang told a packed house at the San Jose State University Event Center. "Accelerated computing is a collaboration, a codesign, a continuous optimization between the architecture of the chip, the systems, the algorithm and the application."

Santa Clara, Calif.-based Nvidia has grown in a few short years into a multibillion-dollar company by marketing its graphical processing units (GPUs) to datacenter operators as the right silicon for processing the flood of data demanded by a new generation of AI-oriented applications.

Coming on the heels of the company's recent acquisition of high-performance networking company Mellanox, this new collection of software-acceleration libraries holds great promise for that market.

"We're seeing a great growth in data," said Mellanox CEO Eyal Waldman, who joined Huang on stage. "An exponential growth. And we're also starting to see that the old program-centric datacenter is changing into a data-centric datacenter, which basically means the data will flow and create the programming. Instead of us creating a program using the data, the data will start creating the program using the data itself. These are things that we can work out and actually get very synergistic architecture solutions for the future for the datacenter."

CUDA-X AI is built on top of Nvidia's CUDA parallel computing platform and programming model for general computing on GPUs. It's designed to provide essential optimizations for deep learning, machine learning and high-performance computing (HPC).

The software "unlocks the flexibility of our Nvidia Tensor Core GPUs," the company said in a blog post, to address the "end-to-end AI pipeline"  (data processing, feature determination, training, verification and deployment).

The CUDA-X AI acceleration libraries have been adopted by a number of companies, including PayPal, SAS, Walmart and Microsoft. Nvidia claims they can speed up machine learning and data science workloads by up to 50x. The software is integrated into the Nvidia T4 GPU servers offered by several top vendors, Huang said, including Cisco, Dell EMC, Fujitsu, HPE, Inspur, Lenovo and Sugon.

Huang also announced a new deep learning partnership with, which will use Nvidia's T4 Tensor Core GPUs for Amazon Web Services (AWS).

"We're going to need a large, large number of partners to be able to take these architectures that are really complicated -- to bring it out into the enterprise," Huang said.

About the Author

John has been covering the high-tech beat from Silicon Valley and the San Francisco Bay Area for nearly two decades. He serves as Editor-at-Large for Application Development Trends ( and contributes regularly to Redmond Magazine, The Technology Horizons in Education Journal, and Campus Technology. He is the author of more than a dozen books, including The Everything Guide to Social Media; The Everything Computer Book; Blobitecture: Waveform Architecture and Digital Design; John Chambers and the Cisco Way; and Diablo: The Official Strategy Guide.


  • Tamper Protection Now Available to Microsoft Defender ATP Subscribers

    The Microsoft Defender Advanced Threat Protection (ATP) E5 subscription plan now has an optional "tamper protection" security feature, Microsoft announced on Monday.

  • Exploring OCR, a New Way To Get Data into Excel

    Microsoft recently added a new optical character recognition feature to Excel that lets users import data from a photograph taken from a smartphone. Here's how to use it.

  • Microsoft Authenticator App To Get Real-Time Phishing Protections

    Microsoft is working on adding capabilities to its Microsoft Authenticator app to help defeat security breaches enabled by advanced attack techniques, including phishing and man-in-the-middle methods.

  • A Quicker Way To Create Hyper-V Inventory Reports

    If you need to generate Hyper-V inventory reports but don't want the hassle of writing your own custom PowerShell script, here is a shortcut.

comments powered by Disqus

Office 365 Watch

Sign up for our newsletter.

Terms and Privacy Policy consent

I agree to this site's Privacy Policy.