Queries on Fine Tuning

Short Course Q&A Finetuning Large Language Models
1

Hi Team,

1.when to use instruction tuning and fine tuning difference
prompt_template_with_input = “”"Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.

### Instruction:
{instruction}

### Input:
{input}

### Response:"""

prompt_template_without_input = """Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{instruction}

### Response:"""

2.when to go with prompt template added in dataset
prompt_template_qa = “”"### Question:
{question}

### Answer:
{answer}"""

3.when to go with only question added in text dataset
prompt_template_q = “”"### Question:
{question}

### Answer:"""

Expecting best solutions for these questions which would be an invaluable assest for my progress. And next steps after Fine tuning.

Thanks in advance.