Maintaining a power balance between generation and demand is generally acknowledged as being essential to maintaining a system frequency within reasonable bounds. This is especially important for linked renewable-based hybrid power systems (HPS), where disruptions are more likely to occur. This paper suggests a prominent modified "Fractional order-proportional-integral with double derivative (FOPIDD2) controller" as an innovative HPS controller in order to navigate these obstacles. The recommended control approach has been validated in power systems including wind, reheat thermal, solar, and hydro generating, as well as capacitive energy storage and electric vehicle. The improved controller's performance is evaluated by comparing it to regular FOPID, PID, and PIDD2 controllers. Furthermore, the gains of the newly structured FOPIDD2 controller are optimized using a newly intended algorithm terms as squid game optimizer (SGO). The controller's performance is compared to benchmarks such as the grey wolf optimizer (GWO) and jellyfish search optimization. By comparing performance characteristics such as maximum frequency undershoot/overshoot, and steadying time, the SGO-FOPIDD2 controller outperforms the other techniques. The suggested SGO optimized FOPIDD2 controller was analyzed and validated for its ability to withstand the influence of power system parameter uncertainties under various loading scenarios and situations. Without any complicated design, the results show that the new controller can work steadily and regulate frequency with an appropriate controller coefficient.