Just gently drive the nut a little deeper with a punch and hammer. Sometimes the riveted nut on those star nuts gets loose and spins freely. You might want to put a fresh one in. In which case simply drive it all the way out through the bottom. Then install a new one through the top.
Sheldon Brown's Bicycle Glossary St--Sz