Not All Pixels Are Created Equal