Hi everyone!
If we want to use a non proprietary LLM that has sensitive specialized data to deliver counselling support (instead of information exchange), shall we link the LLM to a private database (to access the data) and use prompt engineering (to make it less informational but more of listening) OR shall we fine tune the LLM with the specialized data? Let’s say we can have access to local GPUs for fine tuning.
Guidance will be appreciated!