It's still abuse if it wasn't physical. Abuse comes in many forms. Someone can abuse you even if he or she never hit you. Harsh words, criticisms, intimidation, invalidation, mind games, forcing you to perform sexual acts in spite of you not wanting to, isolating you from friends and family, controlling your money, and twisting scripture to claim God is angry with you are all examples of abusive behavior that's not physical.