Why finetune, BasicModelRunner 401 Client Error

Short Course Q&A Finetuning Large Language Models
1

The following code in the notebook throws a 401 Client Error, has anyone made the request to work?

from llama import BasicModelRunner
non_finetuned = BasicModelRunner("meta-llama/Llama-1-7b-hf")
non_finetuned_output = non_finetuned("Tell me how to train my dog to sit")
401 Client Error: Unauthorized for url: https://api.powerml.co/v1/llama/run_program
2

The API-key can be obtained from the lamini page, Authentication -.

After I fetched the API-key I used this approach outlined in another DeepLearning.AI short courses. I paste the details below if someone else runs into the same problem.

from llama import LLMEngine

_ = load_dotenv(find_dotenv())
lamini_api_key = os.environ['LAMINI_API_KEY']

llm = LLMEngine(
    id="marketing",
    config={
        "production": {
            "key": lamini_api_key,
        }
    },
)
_ = load_dotenv(find_dotenv())
lamini_api_key = os.environ['LAMINI_API_KEY']
3

Hey Thanks for sharing the code here, it solved my 401 Client Error: Unauthorized error too!