Fix broken colours with `-j` (#484)