As far as I understand there is no quick magic algorithm to find them: you train... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		iXce on May 21, 2019 \| parent \| context \| favorite \| on: Notes on Weight Initialization for Deep Neural Net... As far as I understand there is no quick magic algorithm to find them: you train the full architecture as usual the long and hard way, then you identify the right subnetwork and you can retrain faster from the architecture and initialization of just this subnetwork

L2R on May 22, 2019 [–]

Based off of the results, you have to train a larger number of architectures to identify the right subnetwork.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact