Use conditional formatting plus the formula
=and(not(isblank(A2)),(isblank(B2)))
to highlight empty cells only on rows with data.
Conditional Formatting - 00:25
Correction - 02:04 the formula should have been =and(not(isblank(A2)),(isblank(B2))).