Gaseous pollutants such as hydrogen gas (H2) are emitted in daily human activities. They have been massively studied owing to their high explosivity and widespread usage in many domains. The current research is designed to analyse optical fiber-based H2 gas sensors by incorporating palladium/graphene oxide (Pd/GO) nanocomposite coating as sensing layers. The fabricated multimode silica fiber (MMF) sensors were used as a transducing platform. The tapering process is essential to improve the sensitivity to the environment through the interaction of the evanescent field over the area of the tapered surface area. Several characterization methods including FESEM, EDX, AFM, and XRD were adopted to examine the structure properties of the materials and achieve more understandable facts about their functional performance of the optical sensor. Characterisation results demonstrated structures with a higher surface for analyte gas reaction to the optical sensor performance. Results indicated an observed increment in the Pd/GO nanocomposite-based sensor responses subjected to the H2 concentrations increased from 0.125% to 2.00%. The achieved sensitivities were 33.22/vol% with a response time of 48 s and recovery time of 7 min. The developed optical fiber sensors achieved excellent selectivity and stability toward H2 gas upon exposure to other gases such as ammonia and methane.