Convexity of the Value Function