Question about Lamini’s output formatting in Lab-2
In Lab-2, we use the ‘output_type’ field to specify the desired output format:
result = llm.generate(prompt, output_type={"sqlite_query": "str"}, max_new_tokens=200)
I’m wondering: Does Lamini’s library handle the creation of the specified output format using the LLM’s response, or is this information passed to the LLM to generate the response in that format directly?
Any insights would be appreciated. Thanks!