The rising number of men dropping out of the workforce could hamper housing, Social Security and economic growth