I see your point. Sorry that I misunderstood your question earlier.
I think the embedding layer is still needed for the training purpose? We didn’t further train the embedding values in our assignment because the data set is not large enough.
1 Like