Abstract: Text similarity measurement has become even more important in natural language processing. Usually, the output of the BiLSTM only takes the last vectors of forward and reverse sequences.