Skip to content

FunASR Chinese Recognition:

FunASR is a set of speech recognition models open-sourced by Alibaba. It performs better than the whisper series in Chinese speech scenarios. The video translation software has supported its use through HTTP calls through the zh_recogn and SenseVoice projects. You only need to deploy the corresponding zh_recogn and SenseVoice integrated packages. After starting, fill in the API address in the video translation to use it.

However, many users are still confused about this operation. Therefore, starting from version v2.97, this function has been integrated into the video translation software, that is, there is no need to deploy and start the zh_recogn and SenseVoice projects separately, and you can use it directly by selecting FunASR Chinese Recognition in the software.

image.png

Select FunASR Chinese in Speech Recognition

After selecting FunASR Chinese Recognition in speech recognition, you can choose to use the paraformer-zh model or the SenseVoiceSmall model. It is recommended to choose the former, which has better effect and speed than the latter.

image.png

Download FunASR Chinese Recognition Model Online for the First Time

In order to avoid the package size being too large, the model of FunASR is not integrated in the package. The first time you use it, it will automatically download from modelscope.cn, and save it to the hub in the models folder in the software directory. Depending on the network conditions, it may take from a few minutes to dozens of minutes, or even dozens of minutes. As long as there is no red error, wait patiently for the download to complete.

image.png

Download FunASR Model File Separately in Advance

If your download speed is very slow and you want to download the model file in advance, you can click this address https://pan.baidu.com/s/1HNvH_riUADtnZew8QjYS9w?pwd=jt5r. After downloading and unzipping, you will see a hub folder. Copy this folder to the models folder in the software directory and overwrite the hub folder with the same name in it.

As shown in the figure, after downloading, there is a hub folder in the compressed package, and there is also a hub folder in the models directory under the software directory

image.png