There are quite a few springs in the bay, we used to fish it all the time walking out or with wheelers, but I know a lot of guys take trucks all the way to littlesoldier.
I'd be leery about that ice. A friend of mine is on the county dive team and it seems like they pull a handful of pickups/atvs out of there each spring.