New ask Hacker News story: Ask HN: How much would it cost to replicate GPT-2's model?
Ask HN: How much would it cost to replicate GPT-2's model?
4 by sharemywin | 1 comments on Hacker News.
Cost 1: Scrape 8 Million articles from Reddit posts. https://ift.tt/1S2KZLm Cost 2: Training a 1.5 B parameter transformer network. I'm assuming it could be trained with google's TPUs. And the model would just be a bigger version of the model open ai released.
4 by sharemywin | 1 comments on Hacker News.
Cost 1: Scrape 8 Million articles from Reddit posts. https://ift.tt/1S2KZLm Cost 2: Training a 1.5 B parameter transformer network. I'm assuming it could be trained with google's TPUs. And the model would just be a bigger version of the model open ai released.
No comments