So I randomly find some of my workers just standing around while the majority of the unit is still doing their task. I don't like to retask them because it seems like I may loose whatever resources some of them may be carrying at the time. What's the deal with this?