Speech-to-Text#

BBF allows you to use your voice to interact with the chatbots, transforming them into voicebots! To do this, it implements a Speech-to-Text component (also known as automatic speech recognition, STT or S2T). It solves the NLP task of transcribing an audio file. Then, the transcription is treated as a typical user text message.

Currently BBF has 2 different implementations for speech-to-text:

  • With HuggingFace models (only tested with openai/whisper models). You need to set the NLP_STT_HF_MODEL bot property. Example model: openai/whisper-tiny (very lightweight model)

  • With the SpeechRecognition Python library. You need to set the NLP_STT_SR_ENGINE bot property.