Variants: One option having 1 less variant than the other not working right

Not sure I am communicating this correctly.  Including images for clarity. 

Can this be customized like this or do I just need to have Canvas Prints and Paper Prints and the variants of size and border under each?  Wondering if I can simply delete one variant from material option and it not transfer to the other option.

For the material option 100% cotton paper I only want the 1" white border variant (Not the 2" printed border variant).  

After setting it all up I deleted the 2" printed border variant from the 100% cotton paper option in  "manage variant" but it is still showing up in the drop down.   Can this be customized?

*Did not include all the sizes in the set up screenshot.