Finite dimensional simple modules of quantum affine algebras of type A correspond to semistandard Young tableaux of rectangular shapes. In this paper, we classify all prime modules corresponding to 2-column semistandard Young tableaux. Moreover, we give a conjectural sufficient condition for a module corresponding to a tableau with more than two columns to be prime.