eIQ® Inference with TensorFlow™ Lite

eIQTensorFlowLite

Integrated into NXP's Yocto development environment, eIQ software delivers TensorFlow Lite for NXP’s MPU platforms. Developed by Google to provide reduced implementations of TensorFlow (TF) models, TF Lite uses many techniques for achieving low latency such as pre-fused activations and quantized kernels that allow smaller and (potentially) faster models. Furthermore, like TensorFlow, TF Lite utilizes the Eigen library to accelerate matrix and vector arithmetic.

TF Lite defines a model file format, based on FlatBuffers. Unlike TF’s protocol buffers, FlatBuffers have a smaller memory footprint allowing better use of cache lines, leading to faster execution on NXP devices. TF Lite supports a subset of TF neural network operations, and also supports recurrent neural networks (RNNs) and long short-term memory (LSTM) network architectures.

Diagram

eIQ® TensorFlow Lite

eIQ<sup>&reg;</sup> TensorFlow Lite
Get diagram PDF

Features

  • Delivered as middleware in NXP Yocto BSP releases
  • NXP eIQ software support available for i.MX applications processors
  • Provides the ability to run inferencing on Arm® Cortex®-M, Cortex-A, Verisilicon GPUs and NPU
  • Faster and smaller than TensorFlow — enables inference at the edge with lower latency and smaller binary size
  • Uses open source libraries to accelerate matrix and vector arithmetic (Eigen and GEMMLOWP)
  • NXP optimized implementation of GEMMLOWP uses Arm® Cortex®-M7 SIMD instructions yielding 2-3x performance increase compared to out-of-the-box implementation

Supported Devices

  • i.MX8: i.MX 8 Family – Arm® Cortex®-A53, Cortex-A72, Virtualization, Vision, 3D Graphics, 4K Video
  • i.MX8M: i.MX 8M Family - Arm® Cortex®-A53, Cortex-M4, Audio, Voice, Video
  • i.MX8MMINI: i.MX 8M Mini - Arm® Cortex®-A53, Cortex-M4, Audio, Voice, Video
  • i.MX8MNANO: i.MX 8M Nano Family - Arm® Cortex®-A53, Cortex-M7
  • i.MX8X: i.MX 8X Family – Arm® Cortex®-A35, 3D Graphics, 4K Video, DSP, Error Correcting Code on DDR

Downloads

Quick reference to our software types.
Filters

2 downloads

  • Examples and Quick Start Software

    MCUXpresso SDK Builder

    EXTERNALRev 1Jan 28, 2021 02:41:001 KBMCUXPRESSO-SDK-EIQ
    Download
  • Software Development Resources

    eIQ Machine Learning Software for i.MX Linux 4.14.y

    EXTERNALRev 0Jun 24, 2019 16:25:001 KBEIQ-MLSOFTWARE
    Download

Note: For better experience, software downloads are recommended on desktop.

Documentation

Quick reference to our documentation types.

Filters

6 documents

Compact List

Application Note (5)
Fact Sheet (1)

Hardware

Quick reference to our board types.
Filters

1-5 of 6 hardware offerings

Show All

Related Software

Quick reference to our software types.

Filters

    Note: For better experience, software downloads are recommended on desktop.

    Training

    Filters

    1 trainings