To perform Medicine Ball Side Raises (On Ball), lie sideways with your right hip in contact with the ball. The body should be straight with the side of your right foot on the floor for stability. Holding the medicine ball at center chest, contract your muscles to pull your left shoulder upward.