/sci/ - Science & Math

File: 81 KB, 1024x989, 1660335578736140.jpg [View same] [iqdb] [saucenao] [google]

Anonymous Wed Sep 28 17:14:16 2022 No.14883109 [Reply] [Original]

can someone explain or link article/tutorial about how generation functions work with transformers (NLP)?
i understand the architecture, how it works etc but i have no fucking clue what the parameters to the generation functions are, what beam search is, why for the same input different outputs can be generate etc and it's completely ommited in everything i come across
if i had to guess then since logits go into the classifier head that outputs basically probabilities of every word occuring next, then beam search/etc are ways to choose words from that probability vector?

>>	Anonymous Wed Sep 28 18:17:53 2022 No.14883238 ok sorry im retarded, found it now kill the thread and my embarrassment

Advanced search
Text to find
Subject [?]Search by post subject. Leave empty for any.
Username [?]Search for user name. Leave empty for any user name.
Tripcode [?]Search for tripcode. Leave empty for any.
Email [?]Search by email. Leave empty for any.
Filename [?]Search by image filename. Leave empty for any.
From Date [?]Enter what date to start searching from. Format is YYYY-MM-DD
To Date [?]Enter what date to start searching until. Format is YYYY-MM-DD
Image hash
Search in	All Posts OPs Only
Deleted posts	Show all posts Show only deleted posts Only show non-deleted posts
Internal posts	Show all posts Show only internal posts Show only archived posts
Order	New posts first Old posts first
Capcode	All Posts Only by Users Only by Mods Only by Admins Only by Developers
Results	Posts Threads
Action	[ Simple ]