Hello everyone,
Do you have any advice on the intuition behind picking the examples which to include in a few shot leaning prompt?
I noticed that if I create my few_shot_prompt with example indices - [40, 80, 120, 33], then I get really great results:
BASELINE HUMAN SUMMARY:
#Person1# teaches #Person2# how to upgrade software and hardware in #Person2#'s system.
MODEL GENERATION - FEW SHOT:
#Person1 recommends upgrading the system of Person2 and adding a painting program to the software.
However if I have example indices - [40, 80, 120, 32], the resullt is quite bad:
MODEL GENERATION - FEW SHOT:
#Person1 wants to upgrade his system. #Person2 wants to add a painting program to his software. #Person1 wants to upgrade his hardware.
I wonder what makes example 33 better than 32?
Here are they:
- Example 32:
Dialogue:
#Person1#: Where are you going for your trip?
#Person2#: I think Hebei is a good place.
#Person1#: But I heard the north of China are experiencing severe sandstorms!
#Person2#: Really?
#Person1#: Yes, it’s said that Hebes was experiencing six degree strong winds.
#Person2#: How do these storms affect the people who live in these areas?
#Person1#: The report said the number of people with respiratory tract infections tended to rise after sandstorms. The sand gets into people’s noses and throats and creates irritation.
#Person2#: It sounds that sandstorms are trouble for everybody!
#Person1#: You are quite right.
What was going on?
#Person2# wants to travel to Hebei but #Person1# informs #Person2# of terrible sandstorms there.
- Example 33:
Dialogue:
#Person1#: Welcome to my birthday party, I am so happy you can come.
#Person2#: Thanks for inviting me. Here is the gift for you. Happy birthday, Francis! Many more happy and healthy years for you!
#Person1#: Thank you, shall I open it now?
#Person2#: Yes, please do.
#Person1#: Wow, a remote car model and my favorite brand. I really like it. That is so nice of you.
#Person2#: Yeah, I was really struggling whether I should give you this nice little car. It was the last one they had and I really like it so much myself.
#Person1#: Typical you, always wanting to keep the best things for yourself. The more I appreciate the gift now.
What was going on?
#Person2# comes to the birthday party of Francis and sends him a remote car model.
Thank you!