MARBLE: Material Recomposition and Blending in CLIP-Space

Figure 1 . Overview. We present MARBLE, a method for performing various material editing in images such as material blending (top row) and parametric control of material properties (bottom row) leveraging CLIP-space and pre-trained generative models. Given two material exemplar images, we can achieve a controllable blend of materials on the object by blending the material representation in CLIP-space. For parametric material attribute control, we learn a shallow network using synthetic data to predict the direction in CLIP-space for changing specific material properties such as metallic.