Metal artifact and contrast enhancement (from gad) look very different. Accumulation in a joint is unusual too, though direct injection during an arthrogram would cause this. It generally goes away over a couple of days as it’s absorbed.
I think you must have misunderstood where the artifact was coming from. Gadolinium retention has been shown to occur, but has not been reliably linked to any clinical symptoms. Gadolinium tissue retention also does not interfere in interpretation.
Making every future MRI worse is of large concern, especially if there are other nonmetallic contrasts.