Allow the linker to be used without retaining CAFs unconditionally