You need to save the OPENAI_API_KEY and optionally OPENAI_ORGANIZATION as environment variables for this to work
This version is a work in progress and is currently in a broken state.
You need to run the following commands from the rs directory: cd rs
- Install Rust
curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh- Install dependancies
cargo build- Run server
cargo runThe request/response model of the api is simple for the single_prompt endpoint. You need to send a string prompt as a GET request. You will get a single string response back. Currently the response limit is capped at 200 tokens
curl -X GET -H "Content-Type: application/json" -d '{"query": "Sample user prompt"}' 127.0.0.1:8001/single_prompt/gitagpt/krishna- Use langchain?