Somehow game doesnt recognize that you have hp item on yourself when you swap the other one with something else

as Im not wearing any hp item at all

first pic here you can see Im wearing my earthgrab hp cloak and rad2 hp bracers




when I go swap my cloak for something else I lose first 2 tiers of hp that I should have because Im still wearing my bracers (as it seems only tier 3 is still applied here)




It gets rather annoying to lose hp all the time like that