NVIDIA T4 enterprise GPUs and CUDA-X acceleration libraries supercharge mainstream servers, designed for today’s modern data centers. With NGC-Ready validation, these servers excel across the full range of accelerated workloads. Optional support through NVIDIA NGC Support Services ensures peace of mind. With NVIDIA T4, IT teams can build out standard GPU-accelerated data center infrastructures with the world’s leading servers.
Up to 33% more performance in virtual desktop infrastructures (VDI)*
Up to 35X faster on machine learning training
Up to 16X faster on deep learning training
Up to 68X faster time to insights on deep learning inference
While deep learning is a fairly recent arrival to the AI market, companies have been using machine learning to glean insights from data for decades. The NVIDIA T4 data center GPU can accelerate these machine learning techniques using RAPIDS, a set of open-source libraries for GPU-accelerating data preparation and machine learning. Using familiar development tools like Python, a T4 GPU can accelerate machine learning up to 35X compared to a CPU-only server, including algorithms like XGBoost, PCA, K-means, k-NN, DBScan, and tSVD.
NVIDIA T4 is based on the revolutionary NVIDIA Turing? Tensor Core technology with multi-precision computing for AI workloads. Powering breakthrough performance from FP32 to FP16 to INT8, as well as INT4, T4 delivers up to 68X higher inference performance than CPUs. And for training, a single server with two T4 GPUs replaces nine dual-socket CPU-only servers.
Developers can unleash the power of Turing Tensor Cores directly through NVIDIA CUDA-X AI software libraries and integrations with all AI frameworks. Built on top of CUDA, NVIDIA’s parallel programming model, CUDA-X libraries provide optimizations for the specific computing requirements of artificial intelligence, autonomous machines, high-performance computing, and graphics.
NVIDIA T4-equipped mainstream servers are certified by our partners for virtual GPU software, ensuring users enjoy high-quality virtual desktop experiences from anywhere, on any device. From knowledge workers and mobile professionals to designers and engineers, T4, when combined with NVIDIA virtual GPU software—NVIDIA GRID? Virtual PC (GRID vPC) and NVIDIA Quadro? Virtual Data Center Workstation (Quadro vDWS)—can accelerate the VDI experience, delivering up to 33 percent better performance than CPU-only VDI environments.
Optimizing software for world-class performance requires a deep understanding of many different software layers, from operating systems and drivers to libraries, frameworks, and applications. NGC containers are pre-built and highly optimized for GPU computing. They bring NVIDIA’s unmatched expertise and ecosystem support for GPU-accelerated deep learning frameworks, RAPIDS software, NVIDIA TensorRT?, and 600+ high-performance computing applications.
NVIDIA’s NGC-Ready program enables all server makers to validate NGC containers on their systems. NGC-Ready servers give data center managers the confidence to deploy GPU-equipped servers, knowing that they can be quickly set up to excel at a wide variety of accelerated applications.
VDI: GRID vPC tested on a server with 2x Intel Xeon Gold 6148 (20c, 2.4 GHz), GRID vPC (using 1B profiles) with 4x T4 GPUs supports 64 user VMs, VMware ESXi 6.7, NVIDIA vGPU Software (410.91/412.16), Windows 10 (1803), 2 vCPUs, 4GB RAM, Resolution 1920x1080 resolution, Single Monitor, VMware Horizon 7.6 User experience was measured using an NVIDIA internal benchmarking tool which measured remoted frames running office productivity applications such as Microsoft PowerPoint, Word, Excel, Chrome, PDF viewing and video playback.
Machine Learning: CPU nodes (61 GB of memory, 8 vCPUs, 64-bit platform), Apache Spark. 200 GB CSV dataset; Data preparation includes joins, variable transformations. GPU Server Config: Dual-Socket Xeon E5-2698 v4@3.6GHz, 20 T4 GPUs on 5 nodes, each with 4x T4 GPUs. All run on InfiniBand network, CPU data for XGBoost and Data Conversion steps are estimated based on measured data for 20 CPU nodes, and reducing execution time by 60% to normalize for training on smaller data set on T4.
Training: Workload: ResNet-50; CPU Server: Dual-Socket Xeon E5-2698 v4@3.6GHz, 512GB System Memory; GPU Server: Dual Xeon E5-2698 v4@3.6GHz with 4x T4 GPUs; Framework: MXNet v1.4; Mixed Precision, CUDA 10.1.105; NCCL 2.4.3, cuDNN 7.5.0.56; cuBLAS 10.1.105; DALI 0.7.0; NVIDIA Driver: 410.104; Batch size: T4: 208 | Dual-Socket CPU Server: 256
Inference: Workload: VGG-19; CPU Server: Dual-Socket Xeon Gold 6140@2.30GHz using OpenVINO Toolkit; GPU Servers: 4x T4 GPUs; TensorRT 5.1 GA; CUDA 10.1.105;
NCCL 2.4.3, cuDNN 7.5.0.56, cuBLAS 10.1.105; NVIDIA Driver 410.104; Batch-size: 128
Cisco enables organizations and partners to embrace the latest innovations that drive digital transformation. We help organizations grow their businesses and respond to changing technology, customer, and market trends. For more than 30 years, Cisco has helped our customers build networks, automate, orchestrate, integrate, and digitize information technology (IT)-based products and services. Today, Cisco is helping lead the way by transforming businesses, governments, and cities worldwide with differentiated innovations like cloud computing, analytics, machine learning, security, collaboration, and artificial intelligence.
Dell empowers countries, communities, customers and people everywhere to use technology to realize their dreams. Customers trust us to deliver technology solutions that help them do and achieve more, whether they're at home, work, school or anywhere in their world.
Regardless of your HPC, AI, or VDI requirements, HPE has the best in class people, technology and partners to ensure you’re ready for today and tomorrows’ projects and challenges. We continuously innovate and deliver differentiated production-level solutions. Get faster insights with accelerated IT and solutions, using leading edge technologies and services from HPE.
Fujitsu is the leading Japanese information and communication technology (ICT) company, offering a full range of technology products, solutions, and services. Approximately 140,000 Fujitsu people support customers in more than 100 countries. We use our experience and the power of ICT to shape the future of society with our customers. Fujitsu Limited (TSE: 6702) reported consolidated revenues of 4.1 trillion yen (US $39 billion) for the fiscal year ended March 31, 2018.
Inspur is a leading intelligent computing solutions provider, ranked among the world’s top three server vendors. Inspur’s cutting-edge hardware products and designs are widely delivered and deployed in major data centers around the globe, serving important technology arenas like open computing, cloud, AI and deep learning. Inspur provides customers with customized IT infrastructures and AI solutions that are Tier 1 in quality and energy efficiency. Inspur’s products are optimized for applications and workloads built for data center environments.
At Lenovo, our goal is to be the most trusted data center partner – empowering customers’ Intelligent Transformation and solving humanity’s greatest challenges.
Sugon is a leading enterprise in the field of HPC, servers, storage, cloud and big data in China. Focus on HPC since 1993 and crown China HPC Top100 9 times in 10 years. sugon has mastered a series of core technologies of HPC, cooling Technology, Network Technology, Artificial Intelligence Technology and so on. Since 2006, strategic partner to NVIDIA. Having full spectrum GPU workstations and servers, inference server, training server, AI/RTX workstation.
Supermicro (SMCI), a leading innovator in high-performance, high-efficiency server technology, is a premier provider of advanced server Building Block Solutions? for Data Center, Cloud Computing, Enterprise IT, Hadoop/Big Data, AI/Deep Learning, HPC and Embedded Systems worldwide. Supermicro is committed to protecting the environment through its “We Keep IT Green?” initiative and provides customers with the most energy-efficient, environmentally-friendly solutions available on the market.
ASRock Rack Inc., established in 2013, specializes in the field of cloud computing server hardware. While inheriting ASRock’s design concepts, “Creativity, Consideration, Cost-effectiveness,” the company is dedicated to bringing the server industry out of the box thinking with the passion to innovate. Leveraged by ASRock’s growing momentum and distribution channels, this young and vibrant company targets the booming market of cloud computing and commits to serving the market with user friendly and eco-friendly "do-it-yourself" server hardware, featuring flexible and reliable products.
GIGABYTE has released and continues to develop a range of high performance computing systems. From strict component selection to a focus on design that meets market requirements, GIGABYTE demands and achieves the high product quality standards. GIGABYTE HPC systems are not only renowned for quality and reliability, but also the flexibility offered that allows scientists to meet simulation and analytics challenges. As a result of close cooperation with NVIDIA, GIGABYTE offers a comprehensive portfolio of systems compatible with NVIDIA Tesla and GRID accelerators.
Quanta Cloud Technology (QCT) is a global datacenter solution provider that combines the efficiency of hyperscale hardware with infrastructure software from a diversity of industry leaders to solve next-generation datacenter design and operation challenges. QCT serves cloud service providers, telecoms and enterprises running public, hybrid and private clouds. Product lines include hyper-converged and software-defined datacenter solutions as well as servers, storage, switches, integrated racks with a diverse ecosystem of hardware component and software partners. QCT designs, manufactures, integrates and services cutting edge offerings via its own global network. The parent of QCT is Quanta Computer, Inc., a Fortune Global 500 corporation.
TYAN is a leading provider of server motherboards and server platforms. TYAN designs, manufactures, and markets advanced x86 and x86-64 server/workstation board technology, platforms, and server solution products. Its products are sold to OEMs, VARs, system integrators and resellers worldwide for a wide range of applications. TYAN enables its customers to be technology leaders by providing scalable, highly integrated, and reliable products for a wide range of applications such as server appliances and solutions for HPC, hyper-scale/data center, server storage, and security appliance markets.
Wiwynn is an innovative cloud IT infrastructure provider of high quality computing and storage products, as well as rack solutions for leading data centers. Wiwynn aggressively invests in next generation technologies for workload optimization and best TCO (Total Cost of Ownership). As an OCP (Open Compute Project) solution provider and platinum member, Wiwynn actively participates in advanced computing and storage system designs while constantly implementing the benefits of OCP into traditional data centers.
ASUS is a Taiwan-based, multinational computer hardware and consumer electronics company that was established in 1989. ASUS became widely known in North America when it revolutionized the PC industry in 2007 with its Eee PC?. Today, the company is pioneering new mobile trends with the ASUS ZenFone? series, and it is rapidly developing virtual and augmented reality products as well as IOT devices and robotics technologies.