A man accused of shoving a woman into the side of a moving New York City subway train was captured in New Jersey on Thursday, police said.