I see what you mean. However, i do believe that if we truly seek to obey God's law when he says do not lie, he will make a better way for us to do what we need that, at the same time, is in alignment with his laws and decrees. I think that lying always has a consequence. Whether we see it right away or not, it either hurts others, or encourages us to vary the authority of the word based on our circumstance or situation. I just thought as I am typing this about all the scripture that you quoted. I notice that especially in the cases were you say lying is okay in some situations, the bible does not say they are wrong. But it does not say they were right for doing it either. We do not know how God dealt with them because of their lying. I think that God is so faithful that he will provide a way so that when we hold his Word in high reverence in our lives, he will pave another way. A better way.
I agree a Christian must not sin against his conscience. If he thinks it is a sin to do something, he shouldn't do it! (James 4:17; Romans 14:23). However, if they are unaware that an action is not sin, it is wise and helpful, at times, to eventually learn more correctly on the subject. Especially in the case where people's lives are at stake, and need to be protected. Such as in Hitler's Germany period. He slaughtered huge numbers of innocent people.
I myself, feel I have seen in the scriptures, that there are cases in which it is a sin to lie, but also cases when it is not a sin to lie. It is always a sin to lie in order to commit sin. But it is not a sin to lie for righteous purposes that are in line with God's Word.
Jesus Himself, lied some:
He told Martha that Lazarus was sleeping. So she and others who heard what He'd said, thought He meant that Lazarus was just sleeping. It wasn't until Jesus explained that Lazarus was dead - that she realized He'd meant that Lazarus was dead!
John 11:11-14
11 These things said he: and after that he saith unto them, Our friend Lazarus sleepeth; but I go, that I may awake him out of sleep.
12 Then said his disciples, Lord, if he sleep, he shall do well.
13 Howbeit Jesus spake of his death: but they thought that he had spoken of taking of rest in sleep.
14 Then said Jesus unto them plainly, Lazarus is dead.
KJV
Also think of how Jesus told temple officials, that if they destroyed the temple, He would build it up again in 3 days. They thought He meant the temple they worshiped in. They didn't know He meant "his body."
John 2:19-21
19 Jesus answered and said unto them, Destroy this temple, and in three days I will raise it up.
20 Then said the Jews, Forty and six years was this temple in building, and wilt thou rear it up in three days?
21 But he spake of the temple of his body.
KJV
And think of the fact that Jesus preached to the crowds in parables, for the purpose that they wouldn't understand them unless they sincerely sought God. But most of them weren't seeking God sincerely. John 6:26-29;
Matt 13:34
34 All these things spake Jesus unto the multitude in parables; and without a parable spake he not unto them:
KJV
Matt 13:13-14
13 Therefore speak I to them in parables: because they seeing see not; and hearing they hear not, neither do they understand.
14 And in them is fulfilled the prophecy of Esaias, which saith, By hearing ye shall hear, and shall not understand; and seeing ye shall see, and shall not perceive:
KJV
But Jesus did explain the meaning of the parables to His disciples.
Matt 13:10-11
10 And the disciples came, and said unto him, Why speakest thou unto them in parables?
11 He answered and said unto them, Because it is given unto you to know the mysteries of the kingdom of heaven, but to them it is not given.
KJV
