This document presents an approach called Pairwise Geometric Matching (PGM) for improving object retrieval in large image datasets. PGM uses the pairwise relations between matched local image features to encode global geometric transformations between images. It consists of three main steps: handling redundant matches, finding global geometric relations, and enforcing local pairwise relations based on the global information. Experiments on standard datasets show PGM outperforms state-of-the-art methods for relevant-irrelevant classification and retrieval accuracy while maintaining efficient computation times for large-scale retrieval.