Not following your line of reasoning here 146, James is prophesying the soon coming judgment otherwise James would not state the judge is at the door ready to "enter".
During the tribulation, right before His return, Jesus, the judge will be ready to return as judge of the earth. This is what James is writing about.