Yes, but it does not allow you to potentially cause a brother to stumble who's conscience doesn't allow him to ignore it. In fact, the law of the Spirit of life DEMANDS that you not cause him to stumble because the law of the Spirit is based on the law of love. Paul said you sin
against Christ when you cause people to go against their conscience:
"take care that this liberty of yours (for example, to not keep Sabbath) does not somehow become a stumbling block to the weak.
11For through your knowledge (that we don't HAVE to keep Sabbath) he who is weak is ruined, the brother for whose sake Christ died.
12And so, by sinning against the brethren and wounding their conscience when it is weak, you sin against Christ."-1 Corinthians 8:9,11-12
You are correct. However at some point we are compelled to move from honoring the conscience of a weaker brother to
Gal 1:8-10
8 But though we, or an angel from heaven, preach any other gospel unto you than that which we have preached unto you, let him be accursed.
9 As we said before, so say I now again, If any man preach any other gospel unto you than that ye have received, let him be accursed.
10 For do I now persuade men, or God? or do I seek to please men? for if I yet pleased men, I should not be the servant of Christ.
KJV
It is one thing to quietly express and act upon a matter of conscience; and a very different issue to teach and promote a false doctrine.