Yes the stock batteries are expensive

I-ZIP RMB Battery Pack Bike Accessories

But I found some discussion about alternatives

Power-Sonic PS-1270 12V/7AH Sealed Lead Acid Battery w/ F1 Terminal

Electric Scooter UB12100 Battery

Just need to get that special battery case from Currie.