That's awesome! Climbing is one of the most enjoyable and rewarding activities, as well as one of the best workouts imaginable. (I have wanted to quit while lifting weights, I have never wanted to quit while on a wall).
The best place to start is just going to your local climbing gym, renting...