If you feel uncomfortable or unsure for any reason, ask for another partner.
Think of it like if you were living in a college dorm and you and your roomate were not getting along, then you would ask to be switched to a new room with someone who you related to better.
Not everyone will have the same experiences or strengths as you.
I don't know the reason you have an accountability partner, but trusting the others knowledge, honestly, and ability to do what you need, and follow through and stay commited, is very important, especially if this is serious for you.
And yes they might take offense to you not feeling comfortable with them, but if you're all in it together, then everyone should be working together to accomplish whatever it is your're doing.