Here is the schematic for an adjustable voltage regulator (see attachment). It is comprised of a LM317, with a potentiometer to adjust the voltage the regulator limits at. It can be set anywhere between 0V to Supply Voltage (you guys said that was around 4 to 6V, right?).