$ cost error in Short course: Evaluating and Debugging Generative AI

Short Course Q&A Evaluating and Debugging Generative AI
1

I did not see a short course area for this course so I am asking my question here.

During the section on Evaluating LLMs, the instructor notes:

How much are we paying for the OpenAI
API to generate these fun names for our assets?
…
So in this case, because we’re using OpenAI, it’s 0.0000015.

The open ai web site has this pricing:

GPT-3.5 Turbo

GPT-3.5 Turbo is optimized for dialogue.

Learn about GPT-3.5 Turbo

Model Input Output
4K context $0.0015 / 1K tokens $0.002 / 1K tokens
16K context $0.003 / 1K tokens $0.004 / 1K tokens

?? Why did the instructor note OpenAI, it’s 0.0000015.? I wish it was - or is it and I missed the memo?

NOTE: I am sensitive about this because overnight one night someone gleefully used my account and ranked up to my notification limit before I stopped it. I do not pass my keys around, however, I could have put a key in one of those Streamlit apps to try it out… either way, OpenAI (reported on 14 July, multiple reportings) has not gotten back to me. Regardless of their ultimate decision to refund me or not, the lack of support is saddening and frustrating when CLEARLY they have the $$ yet seem to lack the motivation to provide better support.

It confuses me that these courses and others insist on using openai or if they do, should insist on better support from the company.

Thank you.

2

I have moved your thread to the correct forum area.

3

Thank you. I apologize because I was not sure where was the best place to post.

4

Hi @happyday! OpenAI’s website lists pricing per thousand tokens, but in the course, the task was to convert input token count to price. To convert from price per thousand tokens to price per token, divide by 1000. So $0.0015 / 1k tokens = $0.0000015 / token.

Sorry to hear your OpenAI API key was stolen and abused. Hope you’ve heard back from OpenAI support by now.