Video compression standards follow certain principles for fr a me identification based on Group of Pictures (GOP). It was observed that instead of following the pre-coded GOP, if fr a mes are adaptively chosen based on simple matching criteria, further processing could be effectively done. It was also noted from the earlier techniques that the presence of B-fr a mes leads to buffering of the memory within the past and future fr a mes during the coding stage. The computational time increases with more number of B-fr a mes. Hence, a novel fr a mework has been emphasized in the present investigation firstly for adaptive fr a me identification and secondly, replacing B-fr a mes with either I-fr a mes or P-fr a mes using NSEW Affine Translation for the purpose of video compression. The result shows that the performance objective evaluation coincides with the subjective evaluation