The Northern Indian Ocean host two recognized Oxygen Minimum Zones (OMZ): one in the Arabian Sea and the other in the Bay of Bengal region. The next-generation sequencing technique was used to understand the total bacterial diversity from the surface sediment of off Goa within the OMZ of Arabian Sea, and from off Paradip within the OMZ of Bay of Bengal. The dominant phyla identified include Firmicutes (33.06 %) and Proteobacteria (32.44 %) from the Arabian Sea, and Proteobacteria (52.51 %) and Planctomycetes (8.63 %) from the Bay of Bengal. Statistical analysis indicates that bacterial diversity from sediments of the Bay of Bengal OMZ is ~ 48 % higher than the Arabian Sea OMZ. Diverse candidate bacterial clades were also detected, whose function is unknown, but many of these were reported from other OMZs as well, suggesting their putative role in sediment biogeochemistry. Bacterial diversity from the present study reveals that the off Paradip site of Bay of Bengal OMZ is highly diverse and unexplored in comparison to the off Goa site of the Arabian Sea OMZ. Functional diversity analysis indicates that the relative percentage distribution of genes involved in methane, nitrogen, sulfur and many unclassified energy metabolisms is almost the same in both sites, reflecting a similar ecological role, irrespective of the differences in phylotypic diversity.