In this tutorial, we will demonstrate how to use One API to help deploy Llama3 to Bytebase SQL editor
gpt-3.5-turbo
(or mapped in One-API). After renaming, the model name is gpt-3.5-turbo
, but indeed it is still Llama3.
YOUR_PATH
in the following command) to save data and logs. For example, you can use the pwd
command in the mac terminal to view the current path and replace YOUR_PATH
with it.
localhost:3000
here to log in to One API dashboard.
root
, password is 123456
.ollama
Llama3
default
gpt-3.5-turbo
SSSS|sssss|1111
) with format APPID|APISecret|APIKey
if ollama has not set up for keyhttp://host.docker.internal:11434
Llama3
) and Model scope (for example gpt-3.5-turbo
).
After clicking Submit, you will see the new API key in My keys list within API keys page. Click Copy to get a token starting with sk-
, with witch you can repalce YOUR_TOKEN
in the code below. If the code runs successfully in your terminal, it means that One API configuration is complete.
YOUR_TOKEN
we generated in One API into OpenAI API Key
bar, and fill the OpenAI API Endpoint
bar with http://localhost:3000
. Click Update.