Deep learning is the current approach in neural machine translation, which requires huge amount of parallel corpus to produce high-quality translation result. The purpose of the study is to develop a bidirectional translation of the English Awngi language pairs using deep learning. Languages need to be translated into other languages to transfer knowledge between language speakers. The use of computer software used to translate one natural language into another is called machine translation. We have conducted the experiment based on LSTM, CNN and Transformer models. Among those models transformer model achieves a BLEU score of 25.78 & 24.94 from English-Awngi and 23.56 & 22.34 from Awngi-English from simple and complex sentences respectively. Keywords— Neural Machine Translation, Deep learning, English-Awngi Machine Translation, LSTM, CNN, Transformer