This is so often quoted and used as a reason for them to get rid of the Lord;s instruction to us. If we followed this as the Lord's guidance of all our actions it would eliminate Christmas, Sunday, Easter, or anything with dates. I cannot believe that God wants that for us. God does want us to not judge others, for that is only the Lord's place in our lives.
This is only put in scripture once, other instructions can be followed all through scripture. As an example, to honor the Sabbath is repeated over and over, yet this of often ignored by Christians who carefully obey this by using it as a reason to not honor other instructions, although it only speaks of judging, not of honoring God at a specified time.