When I copy a closed caption tape to another tape, will the captions still be there?

Yes. The closed captions are part of the video. Unless you interfere with line 21, then any dubs will have closed captioning information. This can sometimes occur with time-based correction.