Private equity has been largely the province of ultra-rich investors, endowments and pension funds. That may be changing.