/ic/ - Artwork/Critique

didn't some anon say that they told the archive team about it?

>>4191536
Yeah, but there were no updates since

>>4191536
I dont think anything ever came of that.

Please can someone explain me this whole situation? I have no clue of what OP is talking about and why should I care.

>>4192659
just another weeb shit with mediocre "tutorials"

>>4192664
You're just another crab and a liar since it's not related in any way to tutorials

>>4192659
It's a drawing website where people post their work, but it had a gimmick where it would save the entire process of your drawing as a video if you drew on the website. You could go through galleries and watch all the works be drawn with the same tools. A lot of varied stuff on there. It is slated to be shut down and all the art with process will be gone. I never used it and just looked a couple times, so this is fairly unbiased

>>4191536
Yeah the work is in progress, but there's some problems

If the writer of this script (https://mega.nz/#!1s92WSKT!aB5_RxZlsLQ95Q0X3Lp8et-CrqlienQXrd_IDLB_edg)) is still here, please do join #drawrnomore at Efnet
Quick link: http://chat.efnet.org:9090/?channels=%23drawrnomore

Your help will be very appreciated.

>>4193217
Hey thanks man, let us know if any updates occur.

>>4193247
Sure thing, I wish I could help them but I don't have the technical knowledge necessary. So if there's any experienced anon who wants to contribute, please do join the IRC.

Also here's the ArchiveTeam info page for Drawr: https://www.archiveteam.org/index.php?title=Drawr

>>4193217
>>4193251
Not the anon, but what do they need help with? Do they not understand the script or how to extend it to encompass the entire site userbase?

>>4194978
They're not really using his script, but they're experiencing the same problem that the script writer anon (>>/ic/thread/S4128602#p4161367)) was facing, which is that some of the .gz files are corrupted.
The script writer anon theorized that the corruption is because drawr store multiple backups (4a90f71cHd1jAW4i.gz, 4a90f71cHd1jAW4i_1.gz, etc.), but the guy in the IRC disagrees. He said that these multiple "backups" might actually be for Drawr's reposting functionality and has absolutely nothing to do with the corruption. They're currently still working on this.
I'm just a messenger, so I don't really know what to make of this.

I'm also having a problem backing up http://drawr.net/sijimiya using the script as the .gz file won't play at all (this doesn't happen with other drawr users), so this is really worrying. Might have something to do with the corruption issue, but idk.

>>4195780
http://drawr.net/show.php?id=6390379
As an example, I tested this one and grabbed all 4 copies of the .gz files.
http://img06.drawr.net/draw/img/166212/56447f97Bdk2aZ93.gz
http://img06.drawr.net/draw/img/166212/56447f97Bdk2aZ93_1.gz
http://img06.drawr.net/draw/img/166212/56447f97Bdk2aZ93_2.gz
http://img06.drawr.net/draw/img/166212/56447f97Bdk2aZ93_3.gz

None of them plays properly using the script writer anon's modified .sfw file.
56447f97Bdk2aZ93_3.gz kinda plays, but it displays an empty canvas and some incomplete brush splotches here and there.

So the backup theory might be wrong after all. Maybe there's a way to combine all 4 of these files in order to play them?

I have not nearly enough programming knowledge to help out, but have you tried asking /g/? Hope you get everything sorted as those gz files are the most important.

>>4195805
best ask r/datahoarders imo. /g/ are too busy squabbling about operating systems.

>>4195809
You might be right but it can't hurt to try I guess. Cute animus tends to be a uniting factor.

>>4195805
>>4195823
I support the idea. A nice OP explaining the situations in a neat way should get them concerned about the massive amount of artworks that will be lost.

Okay, I made it :
>>>/g/73485456

My tech knowledge is pretty low as well so this is all I can do to help. I'll post over /jp/ too just in case.

>>4195809
/g/ here. it's actually desktop threads, not operating systems.
btw did you know i use arch

/jp/ thread made >>>/jp/22388982

Thanks to anyone caring about this.

>>4195789
>>4195780
look into the /g/ thread >>>/g/73485456
the multiple gz files as listed in this xml file which is given the swf player are not backups, but probably all parts of the video

what you need is someone who can analyse the swf player, and optimally extract the video from the gz files into some other format

>>4197764
read >>>/g/73485936

you can use the original swf player from drawr, but need the correct xml file to the image, which contains the correct gz files, which are ALL needed to play the video

>>4195809
>r/datahoarders

Best bet. As annoying as reddit is.

Does anyone have a simple way of getting the .gz rather than using python? I saw the method a few threads back but it seemed a bit too complicated (I'm a dumbass with tech).

>>4197811
Ctrl+Shift+I -> Network tab -> reload page -> load the timelapse video
Then the links to the .gz files should pop up

Btw, please do report any links that fails to be played back offline with the method from >>>/g/73485456

So far, I've found two drawings that fails:
http://drawr.net/show.php?id=7161353
http://drawr.net/show.php?id=799104

The problem is still being investigated in the IRC.

>>4198480
I think those are broken on Drawr's end. They don't play correctly for me using either the site or the standalone player. On the site I just get the finished image for the whole video. Do you know if they ever displayed correctly?

>>4199085
That's not the finished image. It's a repost. Drawr let's you draw over other users posts. The issue is getting the image of the original post getting archived correctly. That's what I'm working on atm. Reading the AMF3 file format is causing issues though.

>>4191511
Is this situation basically like the sadpanda shutdown where everyone was flocking their ass off for?

>>4201117
Pretty much yeah, but the archiving efforts are now centralized, so it's not just gonna be some randos archiving their own stuff.
Also this time it'll 100% actually happen because it's a cold and emotionless corporate decision and not a kneejerk reaction of a ponyfag admin over fake news and his poor wrists.

http://drawr.net/metalunamutant
do you guys know if this jap post in anywhere else? pls help

https://twitter.com/hoshi_kubi/status/1144245896743444481

>>4201939
>>4202094
How the actual fuck is this possible to do with what is pretty much just MSpaint? Just how much raw skills is required to this and how do you train for it? Japs are insane.

>>4202497
Damn

>>4202497
Look closer. The brain is just filling in the missing details.

>>4197788
4chan are more knowledgeable in what they're doing. you'd have a 80% chance of finding a neckbeard on here rather than Reddit.

It's a drawing website, just draw on your own.

Can you still access the drawing program there?
I can't even load their flash player, let alone find where to start the drawing app.

>>4203424
kys

>>4198480
Any updates? How's going the archival project?

>>4203593
Here's some updates:
The code is almost ready to be deployed soon. If the drawr server can handle it, it's possible we can make it before the deadline.
Do make your own personal backups too, though, just in case

The reposts problem will be solved soon I think, but there's also some weird edge cases that I don't fully comprehend.

>>4203439
It's accessible in http://drawr.net/draw.php if you are logged in

You can also get the direct .swf file through http://drawr.net/paintv30.swf if you don't have an account

The drawr app has also been ported to pixiv sketch in https://sketch.pixiv.net/draw/simple, if you want to use it in the future.

>>4203806
Oh man it's really a worse version of mspaint. Really amazing though what people managed to produce with such a ghetto tool.

Anyone getting an infinite load on this drawing?:
http://drawr.net/show.php?id=3063132

>>4201939
https://www.pixiv.net/member.php?id=2244

Not the original anon who made it, but I updated the drawr script. I'm not a coder, so expect a lot of shittiness and bugs. Please do report any errors or mistakes.
https://www99.zippyshare.com/v/ms76bXMY/file.html

what's new:

scrape.py = Updated it so that it grabs all the gz files (it used to only download the first one) plus the xml file (important for offline playback)

xml_proc.py = A new script for processing the files created by scrape.py. This script will process the xml files and generate shortcuts for video playback. Opening the shortcut will instantly play the video in a flash projector. No more awkward manual setup!

In order to use it, you need to first open the script in a notepad and find this line:
flashdir = "C:/path/to/flashplayer_32_sa.exe"
Replace the directory with the directory to your actual flash projector executable.

Note: When you run the script and it asks you for a directory, don't enter the directory with a backslash in the end and don't put quotes around the directory (yeah I know, shitty.)

xml_reset.py = Reverses the changes done by xml_proc.py
Useful if you're moving the directory, since the shortcuts are hardcoded.


Note that playback is not 100% guaranteed, there are a few edge cases where offline playback is simply not yet possible, usually caused by file corruption, reposts or other esoteric functionalities. This is especially true for older drawings.
But it should work for like 80% of the time.

And yeah, I know that ArchiveTeam is already on the process of archiving, but this is just in case of a worst case scenario.
Do make some personal backups with these tools!

>>4197819
Not him but how do you download it? I can see the gz in the list, but there's no option to download it, only a HAR file.

>>4204918
If you can see the gz file in the list, right-click and open in new tab.

>>4204895
Ah fuck, forgot to mention:
When editing the flash projector directory, use forward slashes, instead of the default backslashes you get when you're on windows explorer.

In every other cases, use backslashes like the default.

>>4204923
Ah, looks like my chrome is being an idiot and not auto-downloading things (tried opening in new tab and it won't download), will try fixing that and see if that's what's wrong.

>>4204940
Yeah, it should autodownload, not sure what settings would affect that behaviour.

>>4204948
To be honest my chrome has been doing this for a few months now. It'll download some things fine, but other things it'll refuse to start. It's not a major issue because I rarely need to download important things, gave been meaning to fix it for a while but haven't had a good motive until now.

>>4204895
how do i use this tool ? i have zero knowledge about scripts

>>4204895
It downloads all the images, correct? If so, can someone make a dropbox or mega for the images?

>>4205367
1. Download and install Python 3.x
https://www.python.org/downloads/windows/
Make sure to tick the checkbox that says "Add Python 3.x to PATH"

2. Download Flash Projector
https://www.adobe.com/support/flashplayer/debug_downloads.html
https://fpdownload.macromedia.com/pub/flashplayer/updaters/32/flashplayer_32_sa.exe

3. Download and extract the drawr scripts to a separate folder

4. Inside that folder, open xml_proc.py with your notepad and find the following line:

flashdir = "C:/path/to/flashplayer_32_sa.exe"

Replace the directory with the directory to your actual flash projector executable.
Example: flashdir = "C:/Users/Faggot/Downloads/flashplayer_32_sa.exe"

5. With the folder of the drawr scripts open in your explorer, type 'cmd' to the address bar

6. Enter the following command: py -3 scrape.py [drawr username]
Example: py-3 scrape.py sijiyama

7. Once download is finished, enter the following command: py -3 xml_proc.py

8. Type in the directory of the drawr gallery folder you just scraped, when asked.
Example: C:\Users\Faggot\Downloads\drawr-scraper\sijiyama
Do not put a slash in the end and don't put quotes around it

9. Once the script is finished, open the drawr gallery folder and you'll find shortcut files accompanying each png. Launch any of these shortcuts to view the video.

You might get dependencies error when first launching the script, because I don't know shit about setting them up properly. Just tell me the error message and I'll tell you how to fix it.

What the fuck, you guys are actually organizing and productive for once? This is insane

>>4201939
http://drawr.net/show.php?id=6135385
Any other artists on drawr that draws in this procedural buildup kind of manner? Like starting with soft grays and gradually building up the drawing, instead of direct drawing.

Can a kind anon upload all their saved drawrs in a mega link?

>>4204895
Do you have a mirror of the script? Zippyshare won't work on my ISP right now or it's down completely right now.

Found some uncanny pics from that site 1/3

>>4209713
2\3

>>4209714
3/3

>>4202545
what's there is impressive still

>>4208768
Uploaded to mega this time:
https://mega.nz/#!zPJChIrb!aU_Dl3nIakKpOnKquB253H1gXmaDXzfbj6WM48koZGE

with another update:

scrape.py =
-Updated it so that it no longer 403s on some png files. Check your files created by the previous versions of the script and make sure there were no corrupted pngs.
-Gutted out the -v and -i options because I'm too lazy to make it work

xml_proc.py =
-Generates batch files instead of shortcut files this time. Batch files are more convenient because launching multiple batch files will result into a single combined Flash taskbar icon, instead of multiple split ones that shortcut files will create
-Updated command syntax to make it more consistent. Use the new script this way:
py -3 xml_proc.py C:\Users\Faggot\Downloads\drawr-scraper\sijimiya
-Because of the batch file feature, the flash directory now needs to be formatted this way:
flashdir = "C:\\path\\to\\flashplayer_32_sa.exe"

xml_reset.py =
-Deletes .bat files instead of .lnk files
-Updated command syntax to make it more consistent. Use the new script this way:
py -3 xml_reset.py C:\Users\Faggot\Downloads\drawr-scraper\sijimiya

>>4208320
>-Updated it so that it no longer 403s on some png files. Check your files created by the previous versions of the script and make sure there were no corrupted pngs.
>-Gutted out the -v and -i options because I'm too lazy to make it work
>xml_proc.py =
>-Generates batch files instead of shortcut files this time. Batch files are more convenient because launching multiple batch files will result into a single combined Flash taskbar icon, instead of multiple split ones that shortcut files will create
>-Updated command syntax to make it more consistent. Use the new script this way:
>py -3 xml_proc.py C:\Users\Faggot\Downloads\drawr-scraper\sijimiya
>-Because of the batch file feature, the flash directory now needs to be formatted this way:
>flashdir = "C:\\path\\to\\flashplayer_32_sa.exe"
>xml_reset.py =
>-Deletes .bat files instead of .lnk files

Please would love an archive of drawr files if possile

bump

>>4210046
i keep getting an invalid syntax error when trying to run the scrape. it says py is not a valid so and so with py -3 and it also says that when i put in py-3 with no space :(

>>4206440
>Traceback (most recent call last):
>File "scrape.py", line 5, in <module>
>import requests
>ModuleNotFoundError: No module named 'requests'

>>4212992
also when i enter scrape.py first before the py-3 it tries to run but says invalid syntax

>>4212994
>>4212995
That's really strange. Also py-3 is just my typo, it should always be py -3
Are you really sure you've installed the python setup?
Try to enter this command:
python -V
Post what it says.

>>4212994
Use this:
py -3 -m pip install requests
Then run the script again.

>>4213081
python is not recognized. as internal or external command.

i thought i had installed python before but maybe i need to again

>>4213086
i may be using the wrong version lol i will try again after i install thsi new version

>>4213088
Make sure to get version 3.x
Also make sure to check "Install Python 3.x to PATH" (shouldn't really be necessary in this context, but just in case).

>C:\drawr_rip>python -V
>Python 3.8.0
Also PATH checked as well

Did this
>py -3 -m pip install requests
Got new errors
>Traceback (most recent call last):
>File "scrape.py", line 6, in <module>
>from bs4 import BeautifulSoup
>ModuleNotFoundError: No module named 'bs4'

>>4213130
Use this:
py -3 -m pip install bs4
Then run the script again.

>>4213088
ok i got that working now i have the same thing that
>>4213130
has

>>4213138
>py -3 -m pip install bs4
ok now i got it working
>>4213142
im this one btw. thanks !

>>4213147
now what do i do with the .gz stuff

sorry im a moron

>>4213142
Errors-anon reporting: installed all these pip, ripping [metalunamutant] nao, will put it on zippy because can't go to mega.

>>4213149
ok now i have a syntax error on line 21 with the next step
py -3 xml_proc.py
File xml_proc.py line 21
flashdir = d:/flashplayer32_sa.exe
syntax error : invalid syntax

>>4213149
You've grabbed a user? Then:

>>4206201
>2. Download Flash Projector
>https://www.adobe.com/support/flashplayer/debug_downloads.html
>https://fpdownload.macromedia.com/pub/flashplayer/updaters/32/flashplayer_32_sa.exe

>4. Inside the scripts folder, open xml_proc.py with your notepad and find the following line:

>flashdir = "C:\\path\\to\\flashplayer_32_sa.exe"

>Replace the directory with the directory to your actual flash projector executable (with double slashes).
>Example: flashdir = "C:\\Users\\Faggot\\Downloads\\flashplayer_32_sa.exe"

>7. Once download is finished, enter the following command: py -3 xml_proc.py [drawr gallery path]

>Example: py -3 xml_proc.py C:\Users\Faggot\Downloads\drawr-scraper\sijiyama
>Do not put a slash in the end of the directory and don't put quotes around it

>9. Once the script is finished, open the drawr gallery folder and you'll find bat files accompanying each png. Launch any of these bat files to view the video.

>>4213169
ok i got it to work finally , however the bat files have the wrong directory it comes out as c: but no slashes or something like that

C: lashplayer.exe but there are 2 black fs or whatever before that and note the no slashes

>>4213205
Can you paste your customized flashdir line here and the contents of any one of the bat files here

>>4213210
sec i will make it work on the next galllery and send you that i was able to fix it by just adding in the / and adding the f or whatver but yah i will send it

>>4213212
If you fuck something up, be sure to reset the directory using py -3 xml_reset.py C:\whatever
It will reverse any changes made by xml_proc.py so you can get a clean slate to work with.

>>4213212
OK I GOT IT 100% thanks for all your help codeanon

>>4213238
can it do threads tho now.

>>4213246
You mean like reposts?

>>4213272
http://drawr.net/show.php?id=6887786#rid7156044

these things under the listing of threads. i have actually never used this site before but i like the captures i see

>>4213275
or something like this maybe http://drawr.net/show.php?id=4958464
anything where names are not shown

>>4213286
Huh that is new, never seen something like that. There's really no way of getting the artists' names? Where do you get a listing of these threads?

It's definitely possible to scrape this, the formatting seems pretty much the same. I'll see what I can do tomorrow.

>>4213295
if you translate the top red text it says names are not displayed in this thread, its only in some threads tho some have them

>>4203797
Not him but thank you for the update anon.

Does anyone here have the link to previouse drawr thread that alerted /ic/ that drawr was closing down?

>>4213714
seconded

>>4213714
>>4215220
Ditto

>>4213714
>>4215220
>>4215315
>>/ic/thread/S4128602
>>/ic/thread/S4163966

Anyone else /grabbin/

>>4217013
I'll just save all the drawr art that I like to a Pinterest board

>>4217013
absolutely based.
are you using the archiveteam script?

>>4217953
Nah, wrote my own thing just downloading everything myself, the archive team is like a combined effort, I'm a rogue agent. I'm done scraping the website, just hammering their CDN now to download the thing's I've indexed.

I'm gonna see about how I can share it once I'm done, but it's gonna take a while, I hope I can finish before it all goes offline. I'm just shy of half way done with only the images from profiles and I'm already at like 2 million images spanning 100 GB. I only just started last night, though. Next I need to grab the images that aren't on profiles, only in threads, and then grab all the xml and gz files..

>>4218939
1 million* retard brain

>>4217013
>>4218939
Does your archiving method include artist names?

>>4218971
Yeah I'm saving their ID (drawr.net/user.php?id=ZZZ), their username (drawr.net/XXX) and the display name they have on their profile as well as the little description they've written. The biggest thing I'm lacking is the date of the drawings, since most aren't shown on the profile, you have to go into the post to grab that. Some are shown, but I'd like all of 'em if I'm gonna save it. Going into every drawing so get that would be an extra page load for every image, which is looking to be somewhere between 3-4 million.

any luck in figuring out why some dont play locally?

This madoka http://drawr.net/show.php?id=2323004
has the same issue as >>4198480 but does play on the site
also his profile has some bery nice art

>>4218980
you should consider saving their pixiv links if you aren't already

>>4217013
>>4218939
A real human being, and a real hero

>>4219106
Ah fuck, now I'm gonna have to rescrape the profiles. Ty for the reminder anon.

>>4219102
Seems to work just fine for me. I've edited the .xml file to reflect the local paths to the gz files instead of the drawr urls.

>>4219181
yea thats exactly what i forgot to do so i deleted it..

>>4219235
Kek that last bit adding the fountain water is an incredible punchline

Doing God's work anons

Anyone have a good process / method of converting the videos from flash data to webm or a similar video format? Make everything easier to access / share.
I can't really think of a way to do this for millions of images automatically.. I guess you'd have to write your own flash program that reads the .xml and .gz and records it somehow instead of playing it.. Time to learn flash boys? ;_;

>>4218939
very based

Imagine if a monsterous site like pixiv declared they were shutting down, it'd be on the level of when e-hentai was preparing to shut down.

>>4219964
Not really since pretty much everything is reposted on multiple boorus.

>>4218939
Either mega or dropbox, or google, you're doing gods work.

>>4218939
So,if you archive the site,anyone can have access to it?

>>4218939
Update: Finished downloading the .png's from profiles, pic related is current haul. Just wrote the logic for downloading the .xml and .gz files and started downloading them just now. Total file count from just the profiles is probably going to be over 6 million. Hopefully size doesn't explode on me and a 2 TB disk is enough.

I haven't started looking at threads yet, don't know if I'll get them in time. Need to have logic that checks if an image in a thread has already been downloaded through a persons profile so I don't end up duplicating a ton of images.

Also the .gz files from reposts don't work yet since I haven't parsed them and grabbed the ones that require a previous post's .gz to work. I'm gonna start looking at this while the current download churns away.

>>4220315
If mega lets me upload it all, I don't know what kind of limitations they have. It's going to be a while before I'll manage to upload it too just due to the sheer amount of files.

>>4220362
hell yea based anon
i think youve managed to save this faster than the combined archiveteam efforts
how is archive.org for uploading/sharing? thats where AT upload isnt it?

>>4220362
holy shit what a hero

>>4220362
Thank you anon. Keep us updated, doing god's work!

Only a bit over a week left.

>>4220362
You absolute madman. I think this much space isn't free in MEGA, but I'd gladly contribute to the cost if you'd upload and share it. Just drop a mail or something once it's done. Are you still going for the gz files too?

Only a bit over a week left.

>>4220362
You absolute madman. I think this much space isn't free in MEGA, but I'd gladly contribute to the cost if you'd upload and share it. Just drop a mail or something once it's done.

>>4222913
It's more like 700 gig now and it's not finished yet. Checking mega and they have a download transfer limit. Even if I upgrade to pro for 1 TB storage, download caps at 2 TB, so only like barely 3 people would be able to download it all. The next plan at twice the cost caps at 8 TB. Not well suited for this purpose it seems.

>>4220362
>>4222925
Why not put them at archive.org, onedrive, mediafire? etc There's gotta be multitudes of sites that offer at least better storage, just divide the folders in parts

>>4220362
Why not host a private discord server and dump the files there?

>>4223252
God no, why would you ever suggest this? He should put it on archive.org. Discord is the last place anyone should archive something

>>4222925
Upload it to archive.org, talk to the archive team if you're not sure on the details, but they'll more than likely be more than glad to host it

>December 2nd
Oh fuck I thought it was the 22nd

welp

bump

Also seconding the archive.org idea.

>>4222925
What >>4223249 and >>4223302 said. Contact Archive.org, email them, exaplin the situation. I am sure they'd be more than happy to save all this artwork from disappearing.

Let us know how it goes.

>>4224993
Ah and contact the Archive team too, they might help you.

>>4222925
any updates?

>>4223501
oh shit, 1 week left to go

>>4226383
I have collected perhaps the biggest collection of bad art known to man - might as well have scraped deviantArt. With all the gz files and shit it's at 821 GB right now with around 5 800 000 files. I still have a couple things left to do, like gather repost data to make as much as possible replayable. Also haven't touched anonymous images in threads yet.

Atm I'm backup plan incase the archive team's efforts fail. They are more interested in the whole site being saved in WARC, while I just care about the images and replay data.

>>4227067
Thanks for the good work anon.

Anyone know how to replicate this type of brush/pencil in Clistudio or SAI?
It would be a waste if the tool is gone forever?

Im dumb, How do you guys extract gz file from drawr? it only give me jpeg.

>>4227437
nvm I got it, but I still can get it working.

>>4227067
Did you grab the _1.gz and xml stuff?

>real talk
>says the bitch who just begs for rips

This is all too complicated for me. I'll just do the usual screen record of my favorite artists and go from there.

>>4227474
You’re no better in not helping preserve art you autistic crab. Go get shot faggot.

>>4227464
Yes

>>4227067
Godspeed. To be honest I doubt the archive team will succeed and would love if you chose to share your backup. I know at least when it comes to the wayback machine, they are extremely disorganized.

Bump

>>4219968
>>4219964
Not exactly true. It must be emphasized that the boorus are not true archives. They don't exactly scrape everything on pixiv, daily. The boorus are run by volunteers and sometimes people upload the lower quality twitter fanart rather than the exact same higher quality fanart found on pixiv.

Twitter has been harming the quality of the Boorus sadly since Twitter never intended to host artwork in the first place

You're a godsend anon

>>4230759
Yeah, also once you've familiarized yourself with artists beyond the mainstream, you'd find a lot of them aren't on the boorus

>>4191511
It's a long shot but you think we could convince Minecraft's Notch to buy Drawr or just express some interest that Pixiv maybe delays deleting Drawr?

And despite the site closure announcement, I see the Japanese are still using Drawr. I guess they intend to keep sketching until the site 404s for good.

>>4232098
I'm pretty sure the reason why the site is closing down is due to flash closing down,so I doubt that Notch buying drawr would delay the shut down

Would trying to save a bunch of art from drawr to Pinterest be a useful endeavour,assuming the plan of save all the images from drawr to mega fails?

>>4232941
no not really

>10:01 <@JAA> Just over two thirds done, and ETA would be 45 hours, which is after the deadline.
>10:01 <@JAA> (Assuming the date they specified is JST)
>10:02 <@JAA> 2019-12-02 13:00 JST = 04:00 UTC
>10:02 <@JAA> So about 37 hours left.

Thread theme: https://www.youtube.com/watch?v=oIscL-Bjsq4

aw shit

LAST FUCKING DAY LADS.
Unless it's already been saved and all, in which case, ignore me.

TICK TOCK TICK TOCK

AAAAAAAAAAAAAAAAAAAAAAAAAAAAHHHHHHHHHHHHHHHHHH NOOOOO WHY IS THIS HAPPENINGGGGG

>all of the good artists are coming out of their grave to hold a memorial for drawr

>server's busy
goddamn cunts

>>4235330
Yeah the archive team is hammering their servers atm. ETA has changed. Now only 30min to spare.

>>4235332
Honestly, I'm happy that it's looking like everything will be saved. But trying to save things manually today was beyond despairing.

One more day, and its gone forever, lads....

Everyone on the site is making art saying goodbye.

(I-is everything safe now?)

>>4235647
ArchiveTeam's outcome is looking pessimistic

But if this guy >>4227067 really grabbed it completely correctly, then we have like most of it safe probably. Just missing the repost data.

site closes in less than 24 hours now, whats the situation?

>>4235831
Why pessimistic? They have grabbed way more than I have and are on estimate (ish) to finish completely.
I've grabbed repost data from everything I have now as well but I only went one level deep, I don't have time for more (Going to bed and then work and the site will be dead when I'm home again). Meaning if a post with repost data is relying on another repost (and so on.. these repost chains can go for hundreds of posts), I don't have that deep repost data. Archive team should have it, though.

Also missing anything that's being posted atm. If someone wants to help out (I know archive team is gonna miss these as well), grab the files for the new posts popping up, there's quite a few people posting goodbye pictures and such. These will most likely be lost unless someone helps out.

Anyways I started toying with reimplementing the flash player in javascript, it seems doable, but it isn't 100% accurate, only been at it for a few hours - lots of things that can probably be fixed. I just wanted to see if it was possible to ditch flash.

>>4191511
I dont know the site and dont really care at all but the amount if work anons are putting in trying to preserve and save everything is truly commendable. Gj on showing that this board hasnt completely devolved into retarded fucking weaboo coomers posting their ignorant opinions on everything

>>4236017
I was just skimming through the chat logs and it felt like the archival result will be pretty incomplete.

Fuck I need to grab more good artists before going to sleep just in case they don't make the cut, gimme some good recommendations please I'm desperate. I don't want to miss out on some quality goodies

>>4236017
Hey can I have your repost script, but with unlimited depth? I tried to make the one on the ArchiveTeam github to work, but can't. I'm particularly confused on how to handle wrong hostnames.

>>4236017
>>4236028
will these archives be publicly available?
if so where?

who made this?
http://drawr.net/show.php?id=5575215

Can't somebody link the artist behind this ?

>>4236133
http://drawr.net/wakamee
I think this is the guy, but I can't find the same pic

>>4236133
You can use saucenao to the reverse search drawr pictures
https://drawr.net/show.php?id=2476834

>>4236149
link doesn't work
>>4236133
>>4236150
http://drawr.net/show.php?id=2157483#top

>>4236149
>>4236156
just an s too much. https -> http

would anyone be kind enough to help me grab http://drawr.net/tachi1drawr
they've got 121 pages that manage to stay consistently nice but it'd take forever for my pc to get the entire profile
alternatively is there a way to make this script >>4204895 only grab a certain number of pages?

>>4236156
Thank you

Repost that metalunamutant scrape, please! Shit's dope.

I wish it end a little bit later.
I'm in the middle of my finals so I don't have the luxury of time to collect.

>>4236174
I wish I knew what was going on

>>4236185

>>4236187

>>4236189

>>4236190
>>4236187
>>4236185
>>4236174
Looks cool.Can some body link this? I'll try to save this comic in chronlogi Cal order

>>4201939
>>4236191

>>4236191
I've already saved this, except for the repost stuff because I can't get it to work. I'll share it once this thing blows over if it's somehow not available from the bigger archivists.

>>4236195
do you have the vids too?

It's going to disappear tomorrow, I'm genuinely distraught by how much art is going to be gone forever.

>>4191511
With the deadline quickly approaching, Pixiv company has offered to provide a "bulk download" option as well as being able to move galleries to Pixiv Sketch.
Thoughs?

>>4236219
Yeah. Except for the reposts.

>>4236226
Let's pray that Archiveteam will save them all.

>>4236235
Iirc, the tool only works on your account, which makes me wonder why the fuck won't they just move them all to the new site themselves. Goddamn soulless greedy corporations.

It all returns to dust.

https://www.timeanddate.com/counters/fullscreen.html?mode=a&iso=20191202T13&year=2019&month=12&day=2&hour=13&min=0&sec=0&p0=248&msg=Drawr%20Shutdown

>>4236174
Okay,so I saved a lot of metalunamutants art,even his pretty bad art.Is there a place where I can put it so everyone's can have access to it?

>server is slowing down again
AAAAAAHHHH

>>4236235
I think this only work if the artist do it themselves, anything else not registered will be prone to be terminated to lessen the new server burden.

>>4236235
bulk download for your drawings

>>4236355
MEGA!

>still 500 artist pages opened I need to go through
Fuck.

Oh fuck...

oh SHIT
quick post the best drawr ids NOW

http://drawr.net/mkys
I'm at school right now and I dont have time to grab the rest on time. If anyone got this artist, I would appreciate it.

>>4236594
I'll grab it, no guarantees that I'll make it though

>>4236602
anything is fine anon, I really appreciate it.

So long friend.

>>4236609
NOT YET!
THE SHOW CAN STILL GO ON, JUST A BIT MORE!

>>4236617
I'm guessing the servers got killed momentarily, it's back

>>4236235
yes but pixiv sketch only collect the jpeg. the record will be lost.
REMINDER to follow your artists on another platform before the site get shut down.

it all returns to nothing

I wonder if the archive team or archive.org whatever managed to get everything in the end

>>4236632
No, not completely. Missing about 20k

>>4236641
That's not too bad, using the arrows you could see around 980k, and from what I could see the 2nd post onward didn't appear unless you clicked on the opening image.

Its gone

With some luck the website might return with the galleries still available for a certain amount of time? For artists to have time to make the switch to Pixiv if they desire to? (>>4236235)
Just, the drawing tool won't be there, aka no new posts allowed.

guys help I just started getting this weird error are the gz files and stuff I'm getting still okay

>file "scrape.py" line 83, in <module>
>next_page = soup.find.find_all<"l".<"class":"left-food-link">>[1]
>IndexError: list index out of range

>>4236652
Yeah the site is weirding out right now. Just keep trying.

I also fear that the script will occasionally give a false finish message because the profile page sometimes bug out and made itself look empty when it's not.

>>4236649
It's not, you fagget

>being able to view the rendering process is the most important part.
>but it's all gone now.
Fuuu...

whats going on with the jap side with archiving drawr?

>>4236656
Yep, it's occasionally giving false finish message, make sure to check and retry even when the script is finished

>>4236666
Fuck i wonder what I'm missing

>>4236664
Japs suck at archiving, so probably nothing

>>4236651
They've got until next year to switch

>>4236656
>>4236666
if I start on a new profile it's fine again, but the ones that caused the errors were left incomplete and keep giving me the error message when I try to continue them, should I try xml_reset? I'm kind of illiterate with this sort of thing, sorry

>>4236675
No xml_reset is unrelated to the archiving process. Sorry my shitbrain definitely can't figure this bug out in this narrow amount of time. Maybe some other script writer can chime in.

From my attempts sometimes the error give in sometimes it doesn't when you retry

JUST END MY SUFFERING ALREADY

>>4236685
I see, it might just be bugging out because of connection issues or something, would erasing the folders the script created let me have a fresh start? or could that potentially make things worse somehow? thanks for helping anon I appreciate it

>>4236691
No it really doesn't. The only possible solution is adding a new function to the script to handle these errors, but again, I can't.

JUST FUCK MY SHIT UP

I'm getting sadpanda flashbacks.....

good night sweet princess

Oh the server's picking up it's speed?

RIP

Drawr is gone, boys. Pay your respects.

WHAT THE FUCK MY LIGHTS WENT OUT

It's all tumbling down...

Aaahh FUCK the server is slowing down again

F

Sayonara, Drawr.
For real this time.

F
Was in the middle of backing up.

rip
Im glad I found another tf2 artist in the midst of all this

>>4236761
Same

Those first drawings are lame

F

>>4236767
Soul

>tens of thousands of art pieces disappeared today
It's a sad feeling not knowing what was lost. Bless everyone who helped out.

>>4236762
post more anon will you?

>>4236886
https://mega.nz/#F!zmoRCazL!eKZQjq7NrHFZ7wYz-nBg0Q
for sure
I'd like to see other people's collection too, any niche folks

I'm legitimately sad, someone make a thread on on artist they found please

>>4236028
please PLEASE mega your collection anon I beg of you I didn't get to save anything and I need a lot of these artists

Anyone knows anything about what the archive team (or anyone who tried to archive it all) managed to do? Now that it's over I expected some kind of news in that regard.

>>4237578
it's page says that they missed around 19k images.

>>4237600

Man, that number hurts

>>4237600
>>4237753
Well here's the zinger, where are you getting 19k images? There were 160k IDs left to scrape, some are dead IDs but probably over 100k posts unarchived.

>>4237758
I swear I read 19k, in my defense I had just woken up

>>4237758

GOD FUCKING DAMN IT

I'll upload some of my stuffs on the weekend if this thread is still alive. I'm in the middle of finals so I can't do much.

Question:Once I upload all the metalunamutent scales to mega,is it safe for me to delet it off my device?

>>4236174
>>4236185
>>4236187
>>4236189
>>4236190
Will there be a continuation or translation of this? Does the artist have any other social media accounts?

>>4236028
>>4236099
>>4237431
Ditto

>>4238005
He has a twitter, but he isn't very active on it

>>4237758
>160k IDs left to scrape
Wait a second, do you mean that if you went directly to the url you could see the private images?

>>4238020
Can you link it?

>>4238043
https://twitter.com/hoshi_kubi/status/1144245896743444481

Please post your collections anons. If they are too big for a free uploader account just say something and I will provide.

>>4237967
No, not really. But if you share it several anons will have it even if mega fucks up somehow.

>>4238127
I've backed up a decent amount just using a batch downloader over the past few months. However, there's still 800~ artists I was planning on backing up that I plan to at least try using archive.org to see how much I can get that way.

There are also the thread boards where a lot of Anons show up who don't get caught by downloading through artist profiles. A lot of these threads have some really good artists drawing around certain themes, while others are some pretty great stupid gags. There's tens of thousands of quality images that I haven't even touched there alone, so my collection honestly feels pretty lackluster.

While I am definitely interested in sharing what I have and will have, I do want to wait a little to see how the archiving of others turns out. My biggest concern would be how things are formatted. If there's no grouping by individual artists/threads, I'll upload for sure to at least ensure some of that history stays in tact.

>>4238042
It worked with Tumblr, so probably.

https://mega.nz/#F!pM1BGQDY!SsRJvTX4JNdjq4eaYVu-8w

Here's all the stuff I scraped from metalunamutents

>>4237431
I'll try to upload my collection, it is not a big collection and I also missed a lot because the server was dying in the end and my shitty modified script can't handle it. But that other rogue archivist anon probably have a better collection.

that anon further managed to save it all I thought so what's the problem?

>>4218939
>>4220362
>>4227067
OP here, I can't believe this thread is still up. To the person that downloaded the most images, is that person still here in the thread?

https://mega.nz/#F!yrJlXC5K!oEx3IqpSgY9a-svvbOs2dQ
shogo, jonpe, ozizi, metalunamutant collection, including the gz files as well

I should mention the folders may be incomplete, was archiving 2 hours before drawr went down and had issues with other pages giving errors.

If anyone has riku-usi, tomodaworeru, kokikun and ri-n that would be appreciated

>>4238574
Yep, what's up? I'm just waiting for archive team to put up what they have to the wayback machine. Should be most of it. I'm fiddling with reimplementing the flash player in javascript atm.

>>4238601
https://mega.nz/#F!EzhGiADS!Vz2tDJXMF3PnAJUk3u8Czg

I'm slowly uploading what I have, I didnt really look through the playback files but some of my images are broken, didnt really sort yet.

>>4238632
What I'm worried about is did Archiveteam did anything that'd help link the drawing IDs to the original artist? Because if not, then their collection is as good as gone.

>>4238601
Did you use the updated script to grab the gzs?

>>4239306
thanks
>>4239771
yea

>>4238601
https://drive.google.com/open?id=12jJW5QZvW-ZTs76WUBJxC6AqPQlM0-RY
Kokikun etc.
here's everything i have so far, unfortunately, I downloaded a lot of what I have without archiving in mind.

>>4239769
No idea what their backup looks like

>>4191511
https://archive.org/details/drawr.netarchive
I put what i had up on archive.org, as the desc says it's shitty and incomplete with no gz files but it's what i had, about 200 accounts. i encourage you guys to put what you have up on archive too

>>4240448
list of the artists included

>>4239306
It's a shame how useless some of the .gz data is without the previous reposts. Just looking at some you've saved here, pic related is an example from Inui. Left is what's in the single .gz file and right is the actual picture. It's missing the previous image or .gz that it's based on.

Lots are of course fine, since it's only the case if the artist posted it in multiple passes, and I think archive team has a lot of the repost data.

>>4240755
how the fuck do you view these gz files? i loaded up the swf file, loaded a local gz file from there, but it just keeps showing a loading screen. am i impatient? is this just taking an ungodly amount of time to load?

>>4240769
update: others worked, guess the files in particular i tried were fucked.

>>4240769
The flash player is shit and it just won't load a bunch of them if there's missing data (most files that rely on repost data won't load offline). I've written my own javascript app that reads .gz files and redraws the image. Still a work in progress, but the unpacking + drawing is done-ish. I'll probably share some time in the future.

A bunch of the .gz files are also just corrupt and won't be of any good to anyone. Drawr was pretty busted.

>>4240755
Yeah it is, a lot of mine are also from the first script, I really regret being lazy and not thinking to check my files as I went. I messed up with one of the profiles that I really wanted to keep and half of the pngs and .gz are unusable. Still very grateful to have grabbed anything with ease though.
Thanks again script writer and refiner!

Bump

>>4240803
woah nice work u pretty much single handedly saved drawr

What do I do with the gz files?. Do I just extract them

>>4245028
>get swf player
>open the swf file included in the folder with the gzs
>There will be a bar with an arrow icon, click that to open the gz and it’ll start playing
The gz has to be in the same folder as the swf, and if it just keeps showing a loading screen after you load in a gz then the gz file might be fucked or something.

Any news?

>>4246338
warcs have been posted to archive.org
https://archive.org/details/drawr.net_201911_part4
no fuckin clue how to open them lol
but they're there

>>4247632
>https://archive.org/details/drawr.netarchive
This contains the png images, correct?

>>4247842
Just having a quick look it has 13k images, there were millions on drawr, so no.

>>4247842
i posted that archive, it's not linked to the person who posted the warcs

>>4247978
it does contain pngs but it's not all, or even a massive amount of what was on the site. just what i was able to grab

I have a bunch of art saved from drawr but mega isn't letting me upload them for some reason.I also have a lot miscellaneous artwork that isn't from a single creator.Should I post it here's too in a single folder?

>>4248019
post it to archive.org

>>4248019
> mega isn't letting me upload them for some reason
setup rclone and upload it from there

>>4247632
>>4247842
All the warcs have been pumped into the wayback machine, so browsing drawr on there seems to work fairly well except none of the replays work.. Example https://web.archive.org/web/20190926163311/http://drawr.net/1047 But if you're just interested in the images you should be able to find almost everything.

>>4249384
Holy shit that’s awesome! it really sucks that the replays were lost, but it’s good to see that at least a solid amount of the site was saved!

Since this thread is sinking, anywhere else we can talk about drawr findings? Or are we gonna move it to a new thread?

>>4249410
The replays weren't exactly lost, they just don't work in the wayback machine because of the flash player. It relies on the drawr.net domain.

New Thread
>>4249599

>>4202545
>MS paint
Still impresive