I never stated any different. In James 2:21, we notice that James did not say that Abraham's work of offering up Isaac resulted in God accounting Abraham as righteous. The accounting of Abraham's faith as righteousness was made in Genesis 15:6, many years before his work of offering up Isaac recorded in Genesis 22.
The work of Abraham did not have some kind of intrinsic merit to account him as righteous, but it showed or manifested the genuineness of his faith. This is the "sense" in which Abraham was "justified by works." He was shown to be righteous.
James is not using the term "justified" to mean "accounted as righteous" but is shown to be righteous. James is discussing the evidence of faith (says-claims to have faith but has no works/I will show you my faith by my works - James 2:14-18) and not the initial act of being accounted as righteous with God (Romans 4:2-3).