This is really why a Barbarian is not good at tanking IME. They can take a lot of damage when they are at full, but hit points are a resource like any other and a more expensive one to "recharge" than a lot of other options.
A Bladesinger on the other hand, who it optimized for and only uses...