You are the one who moved the goalpost here. Vanilla OpenSSH doesn't link against xz, period. Not even the portable versions as LibreSSL does for OpenSSL.

If distros randomly patch OpenSSH because of SystemD, it's their problem.