From my experience, the upper radiator hose will also be cold due to lack of coolant flow.
Secondly, they say “Fail-Safe” thermostats “fail” open and remain open when they fail. Not sure about this, however. Never have seen one “fail” in open position.
Thermostats are inexpensive and easy to swap out.