Joe Blow pump heads are servicable. Does the part that popped out appear in this kit? If so, then this comes with instructions and it can easily be brought back.
No, the part isn’t in that kit. Though for $5 it might be worth trying it anyway. I might try bringing the pump to my LBS and seeing what they say – I realize this is hard to diagnose without seeing the pump.