I am also having wall troubles. I got the castle upgrade, but the wall is incomplete. I had a barracks and market on the building plots when the upgrade was initialized, thinking the wall would be built around them. I then removed the structures thinking that would allow the completion of the wall, but it did not.
I am playing as Human in the Wold region.