Many optimization problems involve the determination of a large number of (perhaps vector-valued) parameters which collectively can be represented as a set of points in some space of small dimension.