Classical Primer

[Joel Larsson]

For me it worked in the exact opposite order! Teacher first, then orchestra, then after a while I not only realised what bass playing was about, but what classical music can be!

As for recordings, stick to the ones by the major orchestras. You can find a lot of cheap rubbish if you do a bit of rummaging about at your local used records store, but a recording by a Slovenian student project orchestra really don't hold up to one by the Berlin Phil. If you have a friend with access to a Naxos account, just get started. Naxos used to be infamous for putting out large quantities of records of poor quality, but they appear to have learned their lesson as of late.
But you know, really, classical music is not about the recordings, it's about the concerts. Go to as many as you can. Can be way better than going to the movies. If you don't know how to find a teacher, ask the guys in the pit in the break; if they don't give lessons themselves they'll probably be able to recommend someone.