I have seen this with some other smaller models as well. So, just trying to understand in a general sense as to why the smaller models tend to generate repetitive outputs after a certain point?
Example:
2018 and the first year of my life, I was a little bit nervous about it but I'm so glad I did!
I have been working on this project for over 3 years now and I can honestly say that I have never had any problems with anything before. It is such a great feeling to be able to work with someone who has worked in the industry for many years and I know that they are very passionate about what they do.
I have always loved working with people and I think that is one of the reasons why I started working with them. They are amazing people and I really enjoy working with them because they are so supportive and understanding.
I would like to thank you all for your support and encouragement during this time. I hope that you will continue to learn from me and help me grow as a person.
I am so happy to hear that you are enjoying your new job! I look forward to seeing how you develop and grow as a person.
I am so excited to see what you have planned for us. We are going to be doing our first full-time job in January. I am so excited to get started and I am looking forward to getting started.
I am so happy to hear that you are enjoying your new job! I am so excited to start working with you guys!
I am so happy to hear that you are enjoying your new job! I am so excited to begin working with you guys! I am so excited to start working with you guys!
I am so happy to hear that you are enjoying your new job! I am so excited to start working with you guys! I am so excited to start working with you guys! I am so excited to start working with you guys!
I am so happy to hear that you are enjoying your new job! I am so excited to start working with you guys! I am so excited to start working with you guys! I am so excited to start working with you guys! I am so excited to start working with you guys!
I am so happy to hear that you are enjoying your new job! I am so excited to start working with you guys! I am so excited to start working with you guys! I am so excited to start working with you guys! I am so excited to start working with you guys! I am so excited to start working with you guys!
I am so happy to hear that you are enjoying your new
For generating this, this is the code I used from the course:
outputs = tiny_general_model.generate(
**inputs,
streamer=streamer,
use_cache=True,
max_new_tokens=500, # 128
do_sample=False,
temperature=0.0,
repetition_penalty=1.1
)