If you have an army on the world map it can be attacked by anyone with a simular strength or lower army. The village in the map/ sometimes a small stronghold is a.i and is there more for scenrery than anything else but also there are a.i units that are green that will attack either player.
Human players are normally coloured red and blue.
Hope this helps.
P.S sorry about the spelling