The use of face attributes (color and material) is only possible on the geometry containing the Pattern origin.
Details on this can be found under Section 5.9.2.8.1, “ Render material - Functionality ”.