Always use -Xlinker for -rpath