Hello metaman,
When you are rebuilding the texture, do you also rebuild the UV atlas (and choose Generic mapping mode)? If you leave Keep UV option in Build Texture dialog after filling the holes in the mesh, the newly added geometry wouldn't have any associated texture atlas charts, so you should rebuild the texture from scratch, including the UV layout.