You have to look at which way the graph curves. If its inwards (like an upside down quadratic), then the trapezium will underestimate. If you draw a curve then straight lines from one point of the cruve to another, you can see it misses the top bit off.
Similarly, one that curves outwards, like e^x, if you join points making trapezia under the curve, they overestimate as the straight lines from one point to the next go above the cruve.
Draw a quick little sketch and you'll see.