/biz/ - Business & Finance

File: 102 KB, 751x556, Capture.png [View same] [iqdb] [saucenao] [google]

Scraping Anonymous Tue Nov 28 23:14:48 2017 No.4640466 [Reply] [Original]

Ok biz, I need /biz/ and crypto related ideas for a web scraper. I'll write it and show you the results I just can't think of anything interesting to look for.

Any certain trends on biz or twitter maybe?

>>	Anonymous Tue Nov 28 23:19:40 2017 No.4640571 File: 1.15 MB, 574x892, greatcuck.png [View same] [iqdb] [saucenao] [google] Buy Wabi

Anonymous Tue Nov 28 23:25:43 2017 No.4640709

yeah twitter works. It really depends on what sort of information you want. Are you looking for pumps? News on coins? Normie sentiment?

At the minimum I'd start with /biz/ related twitter accounts, heres one. https://twitter.com/LeverageGod you could add the people he follows to the website pool.
You might be better served by focusing your webscraping on a slower, more structured data source. Have you thought about scraping the bitcoin forums?

Anonymous Tue Nov 28 23:26:02 2017 No.4640721

Coin popularity: Measure how frequent threads about a certain coin appear and how many posts they usually get.

It's pretty straightforward, just measure each thread that's posted by analyzing he OP. Generally, if something is happening to a coin then multiple threads can hit at least 50 posts. Once you do this over a long enough timeframe you can tell whether the /biz/ picks truly pan out or not.

There is rarely a /biz/ consensus, so it's better just to gauge if attention itself is enough to warrant a pump rather than if /biz/ thinks it's a smart buy.

>>	Anonymous Tue Nov 28 23:27:07 2017 No.4640745 >>4640466 good luck with that ive made those before and google will send you messages saying to fuck off or else.

>>	Anonymous Tue Nov 28 23:30:16 2017 No.4640810 >>4640745 well, I'm going to be scraping from direct sources like 4chan twitter reddit and other shit, I will be avoiding google results since I want to target certain sources of data frequency matters too

Anonymous Tue Nov 28 23:35:29 2017 No.4640926
File: 41 KB, 1024x415, pink-dog_1024.jpg [View same] [iqdb] [saucenao] [google]

>>4640721
This is a good one. A friend is working on something similar, I may try my own version.

One question though, target ALL coins, or say like top 100 or top 250 mcap coins?

>>	Anonymous Tue Nov 28 23:46:01 2017 No.4641184 File: 12 KB, 293x148, Discord_2017-11-02_03-01-15.png [View same] [iqdb] [saucenao] [google]

>>	Anonymous Tue Nov 28 23:51:11 2017 No.4641290 >>4641184 Ouch

>>	Anonymous Tue Nov 28 23:55:41 2017 No.4641376 File: 20 KB, 400x400, XMR.png [View same] [iqdb] [saucenao] [google] >>4640466 Buy XMR

>>	Anonymous Tue Nov 28 23:58:16 2017 No.4641438 File: 14 KB, 242x237, 1487866840090.jpg [View same] [iqdb] [saucenao] [google] >>4641376 I already have some XMR go away

>>	Anonymous Wed Nov 29 00:01:03 2017 No.4641501 >>4641438 You dont have WABI tho ;)

>>	Anonymous Wed Nov 29 00:05:38 2017 No.4641608 File: 236 KB, 500x500, tumblr_nyia8rph3p1rmvzs8o1_500.gif [View same] [iqdb] [saucenao] [google] >>4641501 I could but trip is too sp00ky

>>	Anonymous Wed Nov 29 00:10:00 2017 No.4641722 File: 19 KB, 386x202, WABIIIIIIIIIIIIII.png [View same] [iqdb] [saucenao] [google] >>4641608 this cuck is gonna get scammed

>>	Anonymous Wed Nov 29 00:14:06 2017 No.4641828 File: 79 KB, 678x828, iq 999.png [View same] [iqdb] [saucenao] [google] >>4641722 he is a easy prey

>>	Anonymous Wed Nov 29 00:14:19 2017 No.4641837 File: 479 KB, 625x626, 1491550465569.png [View same] [iqdb] [saucenao] [google] >>4641184 >>4641722 >>4641501 >>4640571 plz go this is a thread about web scraping crypto data, NOT disco memes

>>	Anonymous Wed Nov 29 00:15:12 2017 No.4641859 >>4641837 we are giving you free bumbs koda

>>	Anonymous Wed Nov 29 00:17:01 2017 No.4641899 File: 489 KB, 1000x1000, 1490005294157.png [View same] [iqdb] [saucenao] [google] >>4641859 kys you scared away people who actually wanna talk about what I'm interested in doing

>>	Anonymous Wed Nov 29 00:19:43 2017 No.4641963 >>4641899 Nihon Banzai anon

>>	Anonymous Wed Nov 29 00:25:56 2017 No.4642072 File: 30 KB, 1242x239, IMG_1477.jpg [View same] [iqdb] [saucenao] [google] >>4640466 Watch out for this African scammer. Wanted to help me buy weed and decided to pocket the money for himself.

>>	Anonymous Wed Nov 29 00:30:46 2017 No.4642193 File: 669 KB, 750x913, Heheh.png [View same] [iqdb] [saucenao] [google] >>4642072 Here's an IRL

>>	Anonymous Wed Nov 29 00:30:58 2017 No.4642196 File: 11 KB, 328x113, doggo.jpg [View same] [iqdb] [saucenao] [google] >>4640466

>>	Anonymous Wed Nov 29 00:44:00 2017 No.4642515 >>4642196 Brown eyed plebs

>>	Anonymous Wed Nov 29 00:47:13 2017 No.4642597 scrape pubic google/amazon cloud storage for documents with bitcoin account keys.

Advanced search
Text to find
Subject [?]Search by post subject. Leave empty for any.
Username [?]Search for user name. Leave empty for any user name.
Tripcode [?]Search for tripcode. Leave empty for any.
Email [?]Search by email. Leave empty for any.
Filename [?]Search by image filename. Leave empty for any.
From Date [?]Enter what date to start searching from. Format is YYYY-MM-DD
To Date [?]Enter what date to start searching until. Format is YYYY-MM-DD
Image hash
Search in	All Posts OPs Only
Deleted posts	Show all posts Show only deleted posts Only show non-deleted posts
Internal posts	Show all posts Show only internal posts Show only archived posts
Order	New posts first Old posts first
Capcode	All Posts Only by Users Only by Mods Only by Admins Only by Developers
Results	Posts Threads
Action	[ Simple ]