This is not correct. Anchor boxes are based on object shapes only…nothing to do with object type. There are several threads discussing this already in the forum. You can find them with search…
[https://community.deeplearning.ai/search?q=Anchor%20boxes]
This is one of the threads returned by that search that might be helpful…. Number of anchor boxes