even if the other people are truly the astral representation of the people we know in real life,
This is actually uncommon. The language of the internal worlds is symbolic. Usually, we do not see the physical person literally, but something or someone that represents them. In most cases, when you see someone internally, it is not "them." Rather, they are a symbol of something. So, it is necessary to analyze what they symbolize.
For example, if you see a friend attacking you, analyze the character of that person: are they fearful, angry, jealous? Most likely, they are representing that ego of yours, which is attacking you.
This is a huge stumbling block for many people, because they persist in interpreting experiences literally, and start feeling resentful towards others, when in fact the guilty ones are entirely in ourselves.
If someone you know does happen to be attacking you internally, it is generally communicated to us through symbols and layers of meaning. Such as, you may be attacked by a lion (a Leo person), or a bear (a very aggressive, animalistic personality), etc.