This problem result can be a combination of all problems noted above. When processing a weak project, PhotoModeler does its best to solve the model with data provided. If there are too many unreliable matches (due to lack of texture, or lack of overlap, or repeating identical features throughout the object or scene etc.), the solution may not settle down to the correct one.
If you are able to use Control Imports, you may be able to improve the solution by Using Control Points With SmartMatch.
Review the SmartPoints Photo Requirements and SmartPoints Project Requirements to ensure your setup is appropriate for this kind of project.