Set the colour of ruler annotations to the correct palette colour