FunASR Chinese Recognition:
FunASR is a set of speech recognition models open-sourced by Alibaba. It performs better than the whisper series in Chinese speech scenarios. The video translation software has supported its use through HTTP calls through the zh_recogn
and SenseVoice
projects. You only need to deploy the corresponding zh_recogn
and SenseVoice
integrated packages. After starting, fill in the API address in the video translation to use it.
However, many users are still confused about this operation. Therefore, starting from version v2.97, this function has been integrated into the video translation software, that is, there is no need to deploy and start the zh_recogn
and SenseVoice
projects separately, and you can use it directly by selecting FunASR Chinese Recognition in the software.
Select FunASR Chinese in Speech Recognition
After selecting FunASR Chinese Recognition in speech recognition, you can choose to use the paraformer-zh model or the SenseVoiceSmall model. It is recommended to choose the former, which has better effect and speed than the latter.
Download FunASR Chinese Recognition Model Online for the First Time
In order to avoid the package size being too large, the model of FunASR is not integrated in the package. The first time you use it, it will automatically download from modelscope.cn, and save it to the hub
in the models
folder in the software directory. Depending on the network conditions, it may take from a few minutes to dozens of minutes, or even dozens of minutes. As long as there is no red error, wait patiently for the download to complete.
Download FunASR Model File Separately in Advance
If your download speed is very slow and you want to download the model file in advance, you can click this address https://pan.baidu.com/s/1HNvH_riUADtnZew8QjYS9w?pwd=jt5r. After downloading and unzipping, you will see a hub
folder. Copy this folder to the models
folder in the software directory and overwrite the hub
folder with the same name in it.
As shown in the figure, after downloading, there is a hub folder in the compressed package, and there is also a hub folder in the models directory under the software directory