Can anyone explain to me what energy is in machine learning and the idea of minima and how it relates to learning, models etc. More so, i'm also wondering about the whole relationship betwen thermodynamics and machine learning. Whats that about?

File: 6 KB, 275x183, frist.jpg [View same] [iqdb] [saucenao] [google]

Anonymous Sat Sep 2 09:22:34 2017 No.9143701 [Reply] [Original]

Can anyone explain to me what energy is in machine learning and the idea of minima and how it relates to learning, models etc.

More so, i'm also wondering about the whole relationship betwen thermodynamics and machine learning. Whats that about?

Anonymous Sat Sep 2 10:17:32 2017 No.9143784

>>9143701
The only parallel (I'm aware of) between ML and thermodynamics is the concept of entropy.

Entropy, being (informally) a measure of the number of (or more precisely, distribution of) feasible "states" or "configurations" of a system translates naturally to a form of uncertainty quantification in ML.

You may wish to have a look at "Shannon Entropy" if this interests you.

>>	Anonymous Sat Sep 2 12:02:04 2017 No.9144071 >>9143784 Other parallels are the boltzmann distribution. And all neural networks seem to be quantifiable by an energy which seems to have been borrowed from chemical physics (?).

Advanced search
Text to find
Subject [?]Search by post subject. Leave empty for any.
Username [?]Search for user name. Leave empty for any user name.
Tripcode [?]Search for tripcode. Leave empty for any.
Email [?]Search by email. Leave empty for any.
Filename [?]Search by image filename. Leave empty for any.
From Date [?]Enter what date to start searching from. Format is YYYY-MM-DD
To Date [?]Enter what date to start searching until. Format is YYYY-MM-DD
Image hash
Search in	All Posts OPs Only
Deleted posts	Show all posts Show only deleted posts Only show non-deleted posts
Internal posts	Show all posts Show only internal posts Show only archived posts
Order	New posts first Old posts first
Capcode	All Posts Only by Users Only by Mods Only by Admins Only by Developers
Results	Posts Threads
Action	[ Simple ]

/sci/ - Science & Math