Hi,
If you want only the text from material master, then you may make the short text field as display only for the document type in the path: OLME - Purchase Order - Define Screen Layout at Document Level.
But in this case, you may need different PO document type for items without material master. Please check and revert back.
Regards,
AKPT