Nearly one in five prime-age men is not working full-time, a figure typical of a recession’s nadir, not an economic boom.