The secret of elite colleges is to only admit those who would succeed anyway, then take the credit. In the UK Oxford very heavily favours privately educated students from well-connected families for example.
Indeed, "success" includes "passing the interview by wearing the right school tie" oh and the interviewer's boss plays golf with your father. But Silly Valley is no less nepotistic, it just is more subtle about it.