Let's start with the simple stuff and work through this.
First off, if it's a traveler, then it should have disc brakes on the front.
Make sure the booster/master cylinder combo that you are using is the "large" one like in the pic attached. The earlier sii with drum fronts used a much "thinner" booster that simply can't generate enuff "push" to energize the disc brake system. I only bring this up because many times these old rigs have been boneyarded to death and a new owner simply doesn't know what is correct stuff and what is not.
Are you certain that all four brake wheel cylinders/calipers are actuating and not frozen, when heavy pedal pressure is applied, will the brake system stop the vehicle?
Then, verify that there is manifold vacuum available with the engine idling at the vacuum port where the booster hose connects. A nice "target" manifold vacuum level for a sii/345 is 20"hg at say an altitude of 1,000ft. Some can be as low as 16"hg depending upon engine modifications and/or internal engine condition. Below 13>15"hg ya start running into potential loss of "booster power"...and that gets worse as the altitude the rig is running at becomes greater.
Next verify that the "check valve" that is stuck in that grommet on the front of the booster is functional, you can see that item in the pic here on the old booster. Those are dirt cheep to replace and available along with a replacement grommet at any parts house, it is not a part specific to IH only.
Try those simple checks and if ya don't find sumthin' get back to us.