Initially ran the notebook as is and the final output/generation was just a copy of the example json included in the prompt. Possibly because the second to last instruction was to return just the json. I then removed the final line in the prompt “Here is the JSON output:” and no change. I additionally removed the 2nd to last line (the one about only returning the json). Then the output looked somewhat like it should except there was only 1 issue and it was repeated until the completion code was “LENGTH”. I tried upping the temperature to 0.1 but that returned an empty string as the generation. Has something changed with the titan model or is something else going on?
similar issues in L4 where it returned the same issue text as in video but the ‘’ placeholder was unchanged in the output generation.