American Made Advocacy: Batting .333: Great in Baseball, Not in Microelectronics
It’s Only Common Sense: The Best Cold Calling Ideas of All Times
The Doctor’s In: Reliability in the Delivery RoomCross-Industry Hardware Specification to Accelerate AI Software Development
September 16, 2022 | IntelEstimated reading time: 1 minute
Arm, Intel and Nvidia have jointly authored a paper describing an 8-bit floating point (FP8) specification and its two variants E5M2 and E4M3 to provide a common interchangeable format that works for both artificial intelligence (AI) training and inference. This cross-industry specification alignment will allow AI models to operate and perform consistently across hardware platforms, accelerating AI software development.
Computational requirements for AI have been growing at an exponential rate. New innovation is required across hardware and software to deliver computational throughput needed to advance AI.
One of the promising areas of research to address this growing compute gap is to reduce the numeric precision requirements for deep learning to improve memory and computational efficiencies. Reduced-precision methods exploit the inherent noise-resilient properties of deep neural networks to improve compute efficiency.
Intel plans to support this format specification across its AI product roadmap for CPUs, GPUs and other AI accelerators, including Habana® Gaudi® deep learning accelerators.
FP8 minimizes deviations from existing IEEE 754 floating point formats with a good balance between hardware and software to leverage existing implementations, accelerate adoption and improve developer productivity.
The guiding principle of this format proposal from Arm, Intel and Nvidia is to leverage conventions, concepts and algorithms built on IEEE standardization. This enables the greatest latitude for future AI innovation while still adhering to current industry conventions.
Share on:
Suggested Items
Foxconn Shareholders Approve Record Cash Dividend for 2023
05/31/2024 | FoxconnHon Hai Technology Group, at its annual shareholders’ meeting, approved its distributable earnings plan totaling NT$74.86 billion in cash. The cash dividend of NT$5.40 per share for 2023 sets a new high since Foxconn listed in 1991, with the cash dividend payout ratio exceeding 50% for the fifth consecutive year.
Intel AI Platforms Accelerate Microsoft Phi-3 GenAI Models
05/27/2024 | Intel CorporationIntel has validated and optimized its AI product portfolio across client, edge and data center for several of Microsoft’s Phi-3 family of open models.
Siemens Simplifies Development of AI Accelerators for Advanced System-on-chip Designs with Catapult AI NN
05/24/2024 | SiemensSiemens Digital Industries Software announced Catapult™ AI NN software for High-Level Synthesis (HLS) of neural network accelerators on Application-Specific Integrated Circuits (ASICs) and System-on-a-chip (SoCs). Catapult AI NN is a complete solution that starts with a neural network description from an AI framework, converts it into C++ and synthesizes it into an RTL accelerator in Verilog or VHDL for implementation in silicon.
Intel Powers China’s Intelligent Cockpit Market
05/23/2024 | Intel CorporationIntel Corporation announced it will collaborate with Neusoft and ThunderSoft to develop new solutions based on Intel’s AI-enhanced software-defined vehicle (SDV) system-on-chip (SoC) to power the intelligent cockpit of next-generation vehicles for automakers.
Murata Obtains ISO 26262 Certification for Functional Safety in Automotive Applications
05/21/2024 | MurataMurata Manufacturing Co., Ltd., obtained the ISO 26262 development process certification for Functional Safety* Automotive ISO 26262 from the German third-party certifier SGS-TÜV Saar GmbH on February 13, 2024.