Khronos Releases NNEF 1.0 Standard For Optimized Deployment of Trained Neural Networks

VANCOUVER, British Columbia, Aug. 13, 2018 /PRNewswire/ --  The Khronos™Group, an open consortium of leading hardware and software companies creating advanced acceleration standards, announces the ratification and the public release of the NNEF™ 1.0 (Neural Network Exchange Format) specification. After gathering feedback from the industry review of the provisional specification, Khronos releases NNEF 1.0 as a stable, flexible, and extensible open standard for hardware manufacturers to reliably deploy optimized, accelerated neural network inferencing onto diverse edge devices. Together with this release, an ecosystem of tools is now also available on GitHub, including an NNEF parser and converters from Tensorflow and Caffe. Importers into popular inferencing environments, including Android's Neural Network API (NNAPI) and Khronos' OpenVX™, are also being developed.

NNEF was created to reduce industry fragmentation by facilitating the exchange of neural networks among training frameworks and inference engines, increasing the freedom for developers to mix and match the inferencing and training solutions of their choice. The open, royalty-free standard, which is the result of collaboration between industry-leading members of the Khronos NNEF Working Group, provides roadmap stability that hardware and software companies can rely on for product deployment, while maintaining the flexibility to respond to the needs of the rapidly-evolving machine learning industry.

NNEF accommodates a wide range of use-cases and network types. Its base format is designed to be both humanly readable and easy to parse and optimize, and it includes the flexible representation of operator precisions and compound operations to facilitate optimal mapping to diverse accelerator architectures. NNEF extensions allow for human-editing of large networks and handling of specific issues, such as custom data formats for trained network weights.

"Khronos recognized a growing format logjam for companies deploying trained neural networks onto edge devices. We set out to build the first open standard solution for engineers to optimize and deploy trained networks onto diverse inference engines. Core NNEF 1.0 will enable cutting-edge solutions today and also flexibly evolve through its extension mechanisms," said Peter McGuinness, Khronos NNEF working group chair. "In December 2017, we released the developer preview of NNEF and made an open call for industry feedback. Community response has been tremendous, confirming the demand for this standard and enabling us to achieve a responsive and complete NNEF 1.0 specification."

A complete workflow from training through optimization to deployment is possible using NNEF as a standardized transfer format. At launch, the standard will be supported by two open source Tensorflow converters, both for network descriptions based on protobuf and python code, and a converter for Caffe. A Caffe2 open-source importer/exporter that is in development by Au-Zone Technologies will be available in Q3 2018. Various tools from member companies, such as Almotive and AMD, are in development, including an importer to Android NNAPI by National Tsing-Hua University of Taiwan.

The NNEF working group is committed to enabling and encouraging reliable interchange with the rapidly growing number of training frameworks, including Torch, Chainer, Theano, PyTorch, and MXNet with open source importers and exporters. Additional open-source tools, including an NNEF syntax parser and validator, are available now for the easy creation of importers into custom, mobile, and embedded edge-inferencing environments, such as Apple's Core ML and Khronos' OpenVX standard, for vision and inferencing runtime acceleration.

The NNEF 1.0 specification and documentation are freely available on the Khronos website, and NNEF open source tools and projects are available in the Khronos NNEF Tools repository. Khronos' File Format Adopter Program is available, at zero cost, for users of NNEF that desire a formal license to use the NNEF trademark and enjoy the protection of the Khronos Intellectual Property Framework.

Supporting Quotes

"In recent months, several of our partners from the automotive and other industries have expressed their concerns about the challenges and effort required to switch to a new neural network acceleration hardware platform. We have stated publicly many times that we see NNEF as a solution to these challenges. Having been one of the founding members of the NNEF working group, it is great to see the standard become a reality and already being adopted by many key players. As one of the first NN hardware IP providers to offer an SDK with full support for NNEF, we are confident that NNEF will continue to be adopted rapidly across the global NN ecosystem as the trusted global standard for NN exchange," says Marton Feher, head of hardware engineering at AImotive.

"AMD supports open source initiatives designed to enable developers to unlock the full potential of software development without being locked into any proprietary environment," said Greg Stoner, CTO Machine Learning, Radeon Technologies Group, at AMD. "With its release of NNEF 1.0, The Khronos Group gives developers a flexible choice of machine learning framework and hardware within the neural network work-flow lifecycle without constraint."

"Imagination welcomes the introduction of NNEF. PowerVR for many years has been an adopter of Khronos standards and, with support for Neural Networks on our PowerVR GPUs and on our dedicated PowerVR NNA hardware, interoperability is always a concern for our customers. The arrival of the NNEF standard will allow better interchange for neural networks across the industry," says David Harold, VP marketing communications, Imagination.

About The Khronos Group

The Khronos Group is an industry consortium creating open standards to enable the authoring and acceleration of parallel computing, graphics, vision and neural networks on a wide variety of platforms and devices.

Khronos, EGL, glTF, NNEF, OpenVG, OpenVX, OpenXR, SPIR, SPIR-V, SYCL, Vulkan and WebGL are trademarks or registered trademarks of The Khronos Group Inc. OpenCL is a trademark of Apple Inc. and OpenGL is a registered trademark and the OpenGL ES and OpenGL SC logos are trademarks of Hewlett Packard Enterprise used under license by Khronos. All other product names, trademarks, and/or company names are used solely for identification and belong to their respective owners.

Press Contact:
Alex Crabb, Caster Communications Inc.
[email protected] 
401-792-7080

SOURCE The Khronos Group