Oobabooga (TextGen WebUI) is both a frontend and a backend system for text generation inspired by AUTOMATIC1111's Stable Diffusion Web UI.
If you ever want to launch Oobabooga later, you can run the start script again and it should launch itself.
To use Oobabooga as a backend for frontend systems like SillyTavern:
[Oobabooga Folder]/text-generation-webuiwith a code editor or Notepad.
--apiafter --chat. It should look like this.
CMD_FLAGS = '--chat --api'
If you want to make the API public (for remote servers), replace
--public-api. For more flags, see this section of the Ooba Readme file here.
Oobabooga supports both automatic downloads and manual downloads. See either section for your use case.
python download-model.py organization/model
organization/model with the model you wish to download. For example, if you want to download Pygmalion-6B, you will do the following.
python download-model.py PygmalionAI/pygmalion-6b
To download a protected model, setup the environment variables
HF_PASSto your Hugging Face username and password (or User Access Token). The model's terms must first be accepted on the HF website.