[ 3 / biz / cgl / ck / diy / fa / ic / jp / lit / sci / vr / vt ] [ index / top / reports ] [ become a patron ] [ status ]
2023-11: Warosu is now out of extended maintenance.

/lit/ - Literature


View post   

File: 81 KB, 1920x1080, 2017-12-07-141222_1920x1080_scrot.png [View same] [iqdb] [saucenao] [google]
10367983 No.10367983 [Reply] [Original]

I'm working on a project that iterates through all threads on /lit/ and counts up the proper nouns (names, book titles, etc.), then will graph them. Hopefully I will be able to track trends in /lit/'s zeitgeist over time.

Whadda think guys?

>> No.10368053

Do it

>> No.10368296

You should ask whoever runs warosu to give you a copy of the archive.

>> No.10368455

>>10368296
great idea, didn't think about applying it to archives.

>> No.10368468

Really cool anon, hit me up with yous spelunquikal graphs whenever you want

>> No.10368627
File: 46 KB, 1586x946, 1512688031.png [View same] [iqdb] [saucenao] [google]
10368627

>>10368468
Hope this is spelunkquikal enough for you. I think this is a representation of all "People" mentioned on the board.

>> No.10368631

>>10368627
I should say this is not optimized for imageboard speech, so it probably doesn't figure out lowercase names.

>> No.10368682
File: 42 KB, 1920x1046, pol.png [View same] [iqdb] [saucenao] [google]
10368682

And one more for /pol/. This is literature, right?

>> No.10368702

>>10367983
always wanted to do something like this. good luck

>> No.10368725
File: 153 KB, 768x1024, image.jpg [View same] [iqdb] [saucenao] [google]
10368725

This is fucking great

Can you do something like frequency of the /lit/ 100 or just top 10? Get an actual sense of what's discussed...

>> No.10368727

>>10368627
Nick Land mentioned more than Plato

never change, /lit/

>> No.10368755

>>10368682
Please don't post anything from /pol/.
Thanks

>> No.10368805

>>10368627
>Sorry
>Steppenwolf

>> No.10368817

time to skew results

John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green

>> No.10368850

>10368817
John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John GreenJohn Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John GreenJohn Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green John Green

>> No.10368851
File: 48 KB, 1916x719, g.png [View same] [iqdb] [saucenao] [google]
10368851

>>10368725
Please don't post porn or pictures like that on this thread.

And sure here's a pastebin of the top 100 most common Persons on /lit/: The formal definition of "Persons" is going to be whenever the nltk pos_tagger tags it as a Singular Proper Noun and a PERSON.

Bonus: Graph of /g/. Pretty error-prone how it also gets stuff like "Fuck" and "D".
---
paste(.)ee/p/YYsXF

>> No.10368854
File: 51 KB, 1920x1046, lit-1512690568.png [View same] [iqdb] [saucenao] [google]
10368854

>>10368850
It's broken forever now.

>> No.10368926

>>10368854
Pure gold

>> No.10368954
File: 68 KB, 640x480, image.jpg [View same] [iqdb] [saucenao] [google]
10368954

>>10368854

>> No.10369003
File: 44 KB, 598x547, 1512605122780.jpg [View same] [iqdb] [saucenao] [google]
10369003

>>10368854

>> No.10369229

>>10367983
This is pretty awesome, anon. I am trying to learn this kind of thing, but I am a beginner and I am still making basic charts with matplotlib.

Could you share your code? I want to learn to do something like this. Thanks.

>> No.10369437

>>10367983
you're working on a shitpost meter?

why?

>> No.10369455
File: 107 KB, 672x775, image.jpg [View same] [iqdb] [saucenao] [google]
10369455

>> No.10369832

I was working on an attempt to create either topic models of what this board discusses or a word embedding to see the underlying associations held by the board as a whole but I got lazy when it came to formatting the raw data. if i ever get it done though im gonna post it