camenduru/text-generation-webui-colab

Jupyter Notebook

A colab gradio web UI for running Large Language Models

colabcolab-notebookcolaboratorygradiollamallmalpacakoalalamallamasvicuna

主要指標

スター成長

スター

2.1k

フォーク

357

週間成長

—

Issue

5001k1.5k2k

2023年4月2023年10月2024年5月2024年11月2025年6月2026年1月2026年7月

README

🐣 Please follow me for new updates https://twitter.com/camenduru
🔥 Please join our discord server https://discord.gg/k5BwmmvJJU
🥳 Please join my patreon community https://patreon.com/camenduru

🚦 WIP 🚦

🦒 Colab

colab	Info - Model Page
	vicuna-13b-GPTQ-4bit-128g https://vicuna.lmsys.org
	vicuna-13B-1.1-GPTQ-4bit-128g https://vicuna.lmsys.org
	stable-vicuna-13B-GPTQ-4bit-128g https://huggingface.co/CarperAI/stable-vicuna-13b-delta
	gpt4-x-alpaca-13b-native-4bit-128g https://huggingface.co/chavinlo/gpt4-x-alpaca
	pyg-7b-GPTQ-4bit-128g https://huggingface.co/Neko-Institute-of-Science/pygmalion-7b
	koala-13B-GPTQ-4bit-128g https://bair.berkeley.edu/blog/2023/04/03/koala
	oasst-llama13b-GPTQ-4bit-128g https://open-assistant.io
	wizard-lm-uncensored-7b-GPTQ-4bit-128g https://github.com/nlpxucan/WizardLM
	mpt-storywriter-7b-GPTQ-4bit-128g https://www.mosaicml.com
	wizard-lm-uncensored-13b-GPTQ-4bit-128g https://github.com/nlpxucan/WizardLM
	pyg-13b-GPTQ-4bit-128g https://huggingface.co/PygmalionAI/pygmalion-13b
	falcon-7b-instruct-GPTQ-4bit https://falconllm.tii.ae/
	wizard-lm-13b-1.1-GPTQ-4bit-128g https://github.com/nlpxucan/WizardLM
	llama-2-7b-chat-GPTQ-4bit (4bit) https://ai.meta.com/llama/
	llama-2-13b-chat-GPTQ-4bit (4bit) https://ai.meta.com/llama/ 🚦 WIP 🚦 please try llama-2-13b-chat or llama-2-7b-chat or llama-2-7b-chat-GPTQ-4bit
	llama-2-7b-chat (16bit) https://ai.meta.com/llama/
	llama-2-13b-chat (8bit) https://ai.meta.com/llama/
	redmond-puffin-13b-GPTQ-4bit (4bit) https://huggingface.co/NousResearch/Redmond-Puffin-13B
	stable-beluga-7b (16bit) https://huggingface.co/stabilityai/StableBeluga-7B
	doctor-gpt-7b (16bit) https://ai.meta.com/llama/ (https://github.com/llSourcell/DoctorGPT)
	code-llama-7b (16bit) https://github.com/facebookresearch/codellama
	code-llama-instruct-7b (16bit) https://github.com/facebookresearch/codellama
	code-llama-python-7b (16bit) https://github.com/facebookresearch/codellama
	mistral-7b-Instruct-v0.1-8bit (8bit) https://mistral.ai/
	mytho-max-l2-13b-GPTQ (4bit) https://huggingface.co/Gryphe/MythoMax-L2-13b

🦒 Colab Pro

According to the Facebook Research LLaMA license (Non-commercial bespoke license), maybe we cannot use this model with a Colab Pro account. But Yann LeCun said "GPL v3" (https://twitter.com/ylecun/status/1629189925089296386) I am a little confused. Is it possible to use this with a non-free Colab Pro account?

Tutorial

https://www.youtube.com/watch?v=kgA7eKU1XuA

⚠ If you encounter an `IndexError: list index out of range` error, please set the models instruction template.

Screenshot 2023-08-28 165206

Text Generation Web UI

https://github.com/oobabooga/text-generation-webui (Thanks to @oobabooga ❤)

Models License

Model	License
vicuna-13b-GPTQ-4bit-128g	From https://vicuna.lmsys.org: The online demo is a research preview intended for non-commercial use only, subject to the model License of LLaMA, Terms of Use of the data generated by OpenAI, and Privacy Practices of ShareGPT. Please contact us If you find any potential violation. The code is released under the Apache License 2.0.
gpt4-x-alpaca-13b-native-4bit-128g	https://huggingface.co/chavinlo/alpaca-native -> https://huggingface.co/chavinlo/alpaca-13b -> https://huggingface.co/chavinlo/gpt4-x-alpaca
llama-2	https://ai.meta.com/llama/ Llama 2 is available for free for research and commercial use. 🥳

Special Thanks

Medical Advice Disclaimer

DISCLAIMER: THIS WEBSITE DOES NOT PROVIDE MEDICAL ADVICE The information, including but not limited to, text, graphics, images and other material contained on this website are for informational purposes only. No material on this site is intended to be a substitute for professional medical advice, diagnosis or treatment. Always seek the advice of your physician or other qualified health care provider with any questions you may have regarding a medical condition or treatment and before undertaking a new health care regimen, and never disregard professional medical advice or delay in seeking it because of something you have read on this website.