Significant improvement

The last couple of years have seen a very significant improvement in the performance of “Large Language Models” like GPT-3 and now ChatGPT

1 Like

Yes, it is true. It is impressive. Since the “Attention is all you need” paper published in 2017, there’s been a focus on Transformers that have really changed the landscape of AI in many fronts. I think the authors of the Attention paper never imagined that their architecture would cause such a revolutionary impact in the field. And I think that this is just the begining.

1 Like

This is a quote from this other recent thread, which is also worth a look.

Hey @Juan_Olano, do you mind posting a link to the paper? I’d love to take a look at it. I’m sure other community members would love to as well.

Hi @deltannboi ,

Absolutely! This link takes you to this seminal paper, “Attention is all you need”.

For a great introduction to this model I recommend considering the Deep Learning Specialization. In its 5th course, Sequential models, prof. Ng explains very clearly the Attention model.

True. I think it will improve significantly in the future to even make large reports on critical events.