The ball bearing is probably just stuck to the bottom with old oil. Spray some killer penetrant and let sit over night, or perhaps fill the bearing well with acetone ot lacquer thinner (and cover with saran wrap or a cork so it won't evaporate!) and let that sit awhile.
If it still doesn't come out, try a small alnico magnet taped to a stiff copper (or other non-ferrous) wire. And if that doesn't work, get a small stick (like an 1/8" piece of dowel. Make sure the end of the dowel and the top of the ball are clean and dry. And then apply some super glue to the end of the dowel, slide it into the bearing well and stick it to the ball. Wait a bit. It should pull it out, and you can either replace the ball with a new one, or clean off the super glue with super glue remover and a scotch-brite pad.
If all that fails, you can always heat the bottom of the well (from the outside) with a propane torch which should loosen any grunge that's currently acting like glue!
If it still doesn't come out, try a small alnico magnet taped to a stiff copper (or other non-ferrous) wire. And if that doesn't work, get a small stick (like an 1/8" piece of dowel. Make sure the end of the dowel and the top of the ball are clean and dry. And then apply some super glue to the end of the dowel, slide it into the bearing well and stick it to the ball. Wait a bit. It should pull it out, and you can either replace the ball with a new one, or clean off the super glue with super glue remover and a scotch-brite pad.
If all that fails, you can always heat the bottom of the well (from the outside) with a propane torch which should loosen any grunge that's currently acting like glue!