This is a port of web-llm that exposes programmatic access to the Vicuna 7B LLM model in your browser.
If you're looking for a UI, check out the original project linked above.
To run this page requires some set up. Please view the instructions at the original demo page.
Open your page console to see some interim feedback.