TensorFlow Lite is a set of tools that help convert and optimize TensorFlow models to run on mobile and edge devices. It’s currently running on more than 4 billion devices! With TensorFlow 2.x, you can train a model with tf.Keras, easily convert a model to .tflite and deploy it; or you can download a pretrained TensorFlow Lite model from the model zoo.
This is an awesome list of TensorFlow Lite models with sample apps, helpful tools and learning resources -
Please submit a PR if you would like to contribute and follow the guidelines here.
## Contents
Here are some past feature annoucements of TensorFlow Lite:
On-device training - It is finally here! Currently limited to transfer learning for image classification only but it’s a great start. See the official Android sample code and another one from the community (Blog | Android ). |
Here are the TensorFlow Lite models with app / device implementations, and references. Note: pretrained TensorFlow Lite models from MediaPipe are included, which you can implement with or without MediaPipe.
Task | Model | App | Reference | Source |
---|---|---|---|
Classification | MobileNetV1 (download) | Android | iOS | Raspberry Pi | Overview | tensorflow.org |
Classification | MobileNetV2 | Recognize Flowers on Android Codelab | Android | TensorFlow team |
Classification | MobileNetV2 | Skin Lesion Detection Android | Community |
Classification | MobileNetV2 | American Sign Language Detection | Colab Notebook | Android | Community |
Classification | CNN + Quantisation Aware Training | Stone Paper Scissor Detection Colab Notebook | Flutter | Community |
Classification | EfficientNet-Lite0 (download ) | Icon Classifier Colab & Android | tutorial 1 | tutorial 2 | Community |
| Task | Model | App | Reference | Source | | -|-|-|-| | Object detection | Quantized COCO SSD MobileNet v1 (download) | Android | iOS | Overview | tensorflow.org | | Object detection | YOLO | Flutter | Paper | Community | | Object detection | YOLOv5 | Yolov5 Inference | Community | | Object detection | MobileNetV2 SSD (download ) | Reference | MediaPipe | | Object detection | MobileDet (Paper) | Blog post (includes the TFLite conversion process) | MobileDet is from University of Wisconsin-Madison and Google and the blog post is from the Community | | License Plate detection | SSD MobileNet (download) | Flutter | Community | | Face detection | BlazeFace (download ) | Paper | MediaPipe | | Face Authentication | FaceNet | Flutter | Community | | Hand detection & tracking | Palm detection & hand landmarks (download ) | Blog post | Model card | Android | MediaPipe & Community |
| Task | Model | App | Reference | Source | | -|-|-|-| | Segmentation | DeepLab V3 (download) | Android & iOS | Overview | Flutter Image | Realtime | Paper | tf.org & Community | | Segmentation | Different variants of DeepLab V3 models | Models on TF Hub with Colab Notebooks | Community | | Segmentation | DeepLab V3 model | Android | Tutorial | Community | | Hair Segmentation | Download | Paper | MediaPipe |
| Task | Model | App | Reference | Source |
| -|-|-|-|
| Style transfer | Arbitrary image stylization | Overview | Android | Flutter | tf.org & Community |
| Style transfer | Better-quality style transfer models in .tflite | Models on TF Hub with Colab Notebooks | Community |
| Video Style Transfer | Download:
Dynamic range models) | Android | Tutorial | Community |
| Segmentation & Style transfer | DeepLabV3 & Style Transfer models | Project repo | Android | Tutorial | Community |
| Task | Model | App | Reference | Source | | -|-|-|-| | GANs | U-GAT-IT (Selfie2Anime) | Project repo | Android | Tutorial | Community | | GANs | White-box CartoonGAN (download) | Project repo | Android | Tutorial | Community | | GANs - Image Extrapolation | Boundless on TF Hub | Colab Notebook | Original Paper | Community |
| Task | Model | App | Reference | Source | | -|-|-|-| | Pose estimation | Posenet (download) | Android | iOS | Overview | tensorflow.org | | Pose Classification based Video Game Control | MoveNet Lightning (download ) | Project Repository | Community |
| Task | Model | App | Reference | Source | | -|-|-|-| | Low-light image enhancement | Models on TF Hub | Project repo | Original Paper | Flutter | | Community | | OCR |Models on TF Hub | Project Repository | Community
| Task | Model | Sample apps | Source | | ——————- |———————————————————————————————————————————| ————————————————————————————————————————————————————————————————————————————————- | —————— | | Question & Answer | DistilBERT | Android | Hugging Face | | Text Generation | GPT-2 / DistilGPT2 | Android | Hugging Face | | Text Classification | Download | Android |iOS | Flutter | tf.org & Community | | Text Detection | CRAFT Text Detector (Paper) |Download | Project Repository | Blog1-Conversion to TFLite | Blog2-EAST vs CRAFT | Models on TF Hub | Android (Coming Soon) | Community | | Text Detection | EAST Text Detector (Paper) |Models on TF Hub | Conversion and Inference Notebook | Community |
| Task | Model | App | Reference | Source | | —————— |————————————| ————————————————————————————- | ———— | | Speech Recognition | DeepSpeech | Reference | Mozilla | | Speech Recognition | CONFORMER | Inference Android | Community | | Speech Synthesis | Tacotron-2, FastSpeech2, MB-Melgan | Android | TensorSpeech | | Speech Synthesis(TTS) | Tacotron2, FastSpeech2, MelGAN, MB-MelGAN, HiFi-GAN, Parallel WaveGAN | Inference Notebook | Project Repository | Community |
| Task | Model | App | Reference | Source | | —————— |————————————| ————————————————————————————- | ———— | | On-device Recommendation | Dual-Encoder | Android | iOS | Reference | tf.org & Community |
| Task | Model | App | Reference | Source | | —————— |————————————| ————————————————————————————- | ———— | | Game agent | Reinforcement learning | Flutter | Tutorial | Community |
These are the TensorFlow Lite models that could be implemented in apps and things:
These are TensorFlow models that could be converted to .tflite and then implemented in apps and things:
ML Kit is a mobile SDK that brings Google’s ML expertise to mobile developers.
MediaPipe - A cross platform (mobile, desktop and Edge TPUs) AI pipeline by Google AI. (PM Ming Yong) | MediaPipe examples. |
Interested but not sure how to get started? Here are some learning resources that will help you whether you are a beginner or a practitioner in the field for a while.
2020-03-01 Raspberry Pi for Computer Vision (Complete Bundle | TOC) - By the PyImageSearch Team: Adrian Rosebrock (@PyImageSearch), David Hoffman, Asbhishek Thanki, Sayak Paul (@RisingSayak), and David Mcduffee. |