You're right. I found out that in order to avoid this you MUST apply a texture to that face before exporting to OBJ.

If anyone is using AoI, make sure if you apply a texture (rather than a material), do not set it to Projection. This will smear the texture you applied on certain faces of the outgoing model.
(I've not begun using Materials, so I dont know of the settings there...)