3.2. Factsheet
Catalogue
SophonSDK is a one-stop SDK which includes modules related to model conversion, model quantization and algorithm porting. We provide a range of materials including documentation, videos, forums and open source repositories to help users with their algorithm porting and development work.
Please read the development guide first to familiarise yourself with the environment and the use of the SDK. If you encounter problems at any point, you can read the appropriate module documentation for more detailed information, following the guidelines in the table below.
Development guide: It includes: basic concepts and SDK introduction; brief introduction, documentation; acquisition, installation, configuration and update of SDK; quick start examples, model transformation and model quantification, explanation of sample code, etc.
Network and operator support: For support for networks and operators, please see Operator Support in TPU-NNTC Development Reference Manual . You can also view it through the conversion commands in the tool chain.
Multimedia Customer FAQ Handbook : https://doc.sophgo.com/sdk-docs/v23.05.01/docs_latest_release/docs/sophon-mw/faq/html/index.html, which contains frequently asked questions and answers on multimedia.
Official Website Video Tutorial : https://developer.sophon.ai/site/index/course/all/all.html, which includes: smart cards, smart boxes, smart servers and other product introduction video; fast run PCIE mode routines, fast run SoC mode routines, SDK algorithm migration introduction, BMCV programming examples, codec programming examples, BMLang programming examples, TPUKernel programming examples.
Official Website Data Center : https://developer.sophon.ai/site/index/material/28/all.html, The development and user manual mainly includes multimedia (video and picture codec), LIBSOPHON (hardware driver and runtime library), TPU-NNTC (model transformation and quantization), and BMLib (hardware basic interface: device Handle management). Memory management, data handling, API sending and synchronization, A53 enabling, etc.), BMCV (image processing library), BMRuntime (reasoning time library), TPUMLIR (compiler tool chain), TPUKernel (low-level programming interface based on the atomic operation interface of Sophon chip, parallel computing acceleration program can be developed) and so on.
Official Website Download Center : which includes download links to files related to SDK、 K8S Device Plugin & Prometheus Exporter, etc (https://developer.sophon.ai/site/index/material/11/74.html、https://developer.sophon.ai/site/index/material/11/75.html).
Official Forum : https://developer.sophon.ai/forum/view/43.html (welcome to send us a technical support question card on the official website forum)
Cloud Development Platform (SOPHGO TEAM): https://cloud.sophgo.com/developer/platform/index(provide online software and hardware environment for TPU development)
Open source repository:
Comprehensive examples for single models or scenarios sophone-demo:
The pipeline-based high-performance inference framework sophon-pipeline:
High-level interface library for C++/Python encapsulation of the underlying interface sophon-sail:
SE5 box displays images via QT using the HDMI interface: https://github.com/sophon-ai-algo/sophon-qt
BSP: https://gitee.com/sophon-ai/bsp-sdk
BM-FFmpeg: https://github.com/sophgo/sophon_ffmpeg
You are also welcome to send us feedback on your problems with github issues and to submit them to us PR works together on open source repositories.
Resource Centre |
Description |
LIBSOPHON contains BMCV, BMRuntime, BMLib and other libraries, which are used to drive VPP, TPU and other hardware to complete image processing, tensor operation, model reasoning and other operations. |
|
BMCV provides a set of machine vision library optimized based on Sophon AI chip, which can accelerate image processing and tensor operation. By using chips such as TPU, VPP, JPU, etc., color space conversion, scale transformation, affine transformation, transmission transformation, linear transformation, picture frame, JPEG coding and decoding, BASE64 coding and decoding, NMS, sorting, feature matching and other operations are completed. |
|
BMLIB is a layer of underlying software library encapsulated on the kernel driver, which is responsible for device Handle management, memory management, data handling, API transmission and synchronization, A53 enabling, setting TPU working frequency, etc. |
|
BMRuntime provides rich interfaces to drive BMODEL to be executed in SOPHON TPU chips. |
|
Drive VPU to parse RTSP stream, GB28181 stream, video codec and other multimedia related |
|
Frequently asked questions and answers on multimedia |
|
User manual for multimedia tools |
|
It contains a suite of tools for compiling and quantifying the model. |
|
User’s manual for model conversion tool kit |
|
The bottom programming interface based on the atomic operation interface of Sophon chip |
|
The development process and steps of TPUKernel |
|
TPU Compiler Project of Chip |
|
Sample program of TPUMLIR |
|
Detailed manual of BM1684X series AI computing module (including development board) |