Okay thank you...I am new to this..
Are you asking if that the only time that it is permissible to be remarried is when the divorce was the result of adultery? I really don't believe so. I don't believe that you truly have a valid marriage in the eyes of God if God did not join the two together in the first place. A person that even thinks about committing adultery has already committed adultery in their heart. I really do not believe that God is heartless and does not consider each unique situation that led to the divorce and the desire to one day know true happiness in marriage, perhaps for the first time.
From what you have said about your situation you should not have any qualms whatsoever to consider remarriage.