Speaking the Language of Color