They want you depict the number line with the semi-interval (a,b] cut off:
==============(------------]===============(number line)==============
a b
The entire ray ( , ] belongs to R \ (a,b], including the point x = a.
The set x > b also belongs to R \ (a,b], but the point x= b does not belong to this set. It is excluded from the set.