Sophon Demo is developed based on the SophonSDK interface and provides a series of samples for mainstream algorithms. It includes model compilation and quantization based on TPU-NNTC and TPU-MLIR, inference engine porting based on BMRuntime, and pre and post-processing algorithm migration based on BMCV/OpenCV.
SophonSDK is a custom deep learning SDK of Sophon based on its self-developed AI chip, covering model optimization, efficient runtime support, and other capabilities required for the inference phase of neural networks, providing an easy-to-use and efficient full-stack solution for deep learning application development and deployment. It is currently compatible with the third-generation BM1684 chip and supports the fourth-generation BM1684X chip.
| Contents | Algorithm Categories | Programming Languages | BModel | Multi-batch Support | Preprocessing Libraries |
|---|---|---|---|---|---|
| LPRNet | License plate recognition | C++/Python | FP32/INT8 | YES | BMCV/OpenCV |
| ResNet | Image classification | C++/Python | FP32/INT8 | YES | BMCV/OpenCV |
| RetinaFace | Face detection | C++/Python | FP32 | YES | BMCV/OpenCV |
| YOLOv5 | Object detection | C++/Python | FP32/FP16/INT8 | YES | BMCV/OpenCV |
| yolact | Instance segmentation | Python | FP32 | YES | BMCV/OpenCV |
| PP-OCR | OCR | Python | FP32 | YES | OpenCV |
| YOLOv34 | Object detection | C++/Python | FP32/INT8 | NO | BMCV/OpenCV |
| YOLOX | Object detection | C++/Python | FP32/INT8 | YES | BMCV/OpenCV |
| SSD | Object detection | C++/Python | FP32/INT8 | YES | BMCV/OpenCV |
| CenterNet | Object detection、Posture recognition | C++/Python | FP32/INT8 | YES | BMCV |
| OpenPose | Human body key point detection | C++/Python | FP32/INT8 | YES | BMCV/OpenCV |
| C3D | Video motion recognition | C++/Python | FP32/FP16/INT8 | YES | BMCV/OpenCV |
| YOLOv8 | Object detection | C++/Python | FP32/FP16/INT8 | YES | BMCV/OpenCV |
| DeepSORT | MultiObject Tracker | C++/Python | FP32/FP16/INT8 | YES | BMCV/OpenCV |
| ByteTrack | MultiObject Tracker | C++/Python | FP32/FP16/INT8 | YES | BMCV/OpenCV |
| YOLOv5_opt | Object detection | C++/Python | FP32/FP16/INT8 | YES | BMCV |
| version | description |
|---|---|
| 0.1.7 | Fix documentation and other issues, some demos support BM1684 mlir, refactor PP-OCR/CenterNet, sail support YOLOv5. |
| 0.1.6 | Fix documentation and other issues, add ByteTrack/YOLOv5_opt samples. |
| 0.1.5 | Fix documentation and other issues, add DeepSORT sample, refactor ResNet/LPRNet samples. |
| 0.1.4 | Fix documentation and other issues, add C3D and YOLOv8 samples |
| 0.1.3 | Add OpenPose sample, refactor YOLOv5 sample (including adapting arm PCIe, supporting TPU-MLIR to compile BM1684X model, using ffmpeg component to replace opencv decoding, etc.) |
| 0.1.2 | Fix documentation and other issues, refactor SSD related samples, LPRNet/cpp/lprnet_bmcv use ffmpeg component to replace opencv decoding |
| 0.1.1 | Fix documentation and other issues, refactor LPRNet/cpp/lprnet_bmcv with BMNN related classes |
| 0.1.0 | Provide LPRNet and other 10 samples, adapt BM1684X (x86 PCIe, SoC), BM1684 (x86 PCIe, SoC) |
Sophon Demo mainly depends on tpu-mlir, tpu-nntc, libsophon, sophon-ffmpeg, sophon-opencv, sophon-sail, whose version requirements are as follows:
| sophon-demo | tpu-mlir | tpu-nntc | libsophon | sophon-ffmpeg | sophon-opencv | sophon-sail | Release Date |
|---|---|---|---|---|---|---|---|
| 0.1.7 | >=1.2.2 | >=3.1.7 | >=0.4.6 | >=0.6.0 | >=0.6.0 | >=3.6.0 | >=23.07.01 |
| 0.1.6 | >=0.9.9 | >=3.1.7 | >=0.4.6 | >=0.6.0 | >=0.6.0 | >=3.4.0 | >=23.05.01 |
| 0.1.5 | >=0.9.9 | >=3.1.7 | >=0.4.6 | >=0.6.0 | >=0.6.0 | >=3.4.0 | >=23.03.01 |
| 0.1.4 | >=0.7.1 | >=3.1.5 | >=0.4.4 | >=0.5.1 | >=0.5.1 | >=3.3.0 | >=22.12.01 |
| 0.1.3 | >=0.7.1 | >=3.1.5 | >=0.4.4 | >=0.5.1 | >=0.5.1 | >=3.3.0 | - |
| 0.1.2 | Not support | >=3.1.4 | >=0.4.3 | >=0.5.0 | >=0.5.0 | >=3.2.0 | - |
| 0.1.1 | Not support | >=3.1.3 | >=0.4.2 | >=0.4.0 | >=0.4.0 | >=3.1.0 | - |
| 0.1.0 | Not support | >=3.1.3 | >=0.3.0 | >=0.2.4 | >=0.2.4 | >=3.1.0 | - |
Note: The version requirements may vary from sample to sample, depending on the README of the routine, and other third-party libraries may need to be installed.
Please get the related documents, materials and video tutorials through Technical Materials on the official website of Sophon.
The Sophon community encourages developers to communicate and learn together. Developers can communicate and learn through the following channels.
Sophon community website: https://www.sophgo.com/
Sophon Developer Forum: https://developer.sophgo.com/forum/index.html
Contributions are welcome. For more details, please refer to our Contributor Wiki.