I have INSANE amounts of porn. An amount that could probably rival most hentai/porn sites. I've accumulated nearly 20TB through long term site-ripping that is automated/manual.
How can I organize this massive collection and give it to the masses? I've thought of multiple possibilities:
>> phpBB (but php is ass)
>> chan (but no long term storage option)
>> porn site (dmca'd constantly)
What can I do to share this accumulated wealth? I also need to find a way to eliminate duplicate data. I've used visipics to eliminate duplicate image files, but what about videos etc and other data types?
make an ftp server and post the url here faggot
>>51239529
>I've accumulated nearly 20TB
w-why
>>51239549
I don't really want to run an FTP of that size from my home network. Is there a way to offer this on the DL, without my real identity being known?
So far as I know, none of the contents can be considered illegal, at least in the US.
Torrentsync
>>51239552
Dunno, really. I just go, save, catalog.
I have browser extensions specifically made to rip videos/images from any site I visit.
Some are an assache, because the images are stored in randomly placed indexed locations, but it just takes longer. Doujin-moe is like this, took me 2 weeks to fully rip the site.
>>51239529
Make some smaller torrents or a huge torrent and magnet link
Start your own private porn tracker and a new torrent group.
>>51239589
I have thought of going this route, but it would take very large amount of time. To upload everything.
>>51239549
this
>>51239603
>>51239549
Maybe both...
My main concern is having high availability. Is a hentai@home a good possibility?
>>51239529
> I also need to find a way to eliminate duplicate data. I've used visipics to eliminate duplicate image files, but what about videos etc and other data types?
At this point, only eliminating exact duplicates is particularly realistic.
Sure, there are perceptual hashes and a thousand experimental similarity comparison algorithms but they're not something you can get and reliably use to automatically kill duplicates in a piece of software yet.
If it's not an exact duplicate but just a video that was encoded with 2 codecs, already kinda forget it.
>>51239603
>picture
source pls
>>51239604
It cannot really take a smaller amount of time with other methods, can it?
In the best case, you only upload one copy, and other torrent clients with fast internet connection take it from there to thousand other clients, that never happens with FTP.
In the other cases, you just seed for as long as you care and people got what they got.
>>51239626
I figured as much. Most of what I've seen so far hasn't been able to effectively discern duplicates of my video library, which is the bulk of the collection.
>>51239657
Are there any cloud hosting services that won't be an NSA nightmare?
>>51239630
Xev Bellringer
>>51239660
Yea, won't work. Just eliminate the exact duplicates (same file size -> same hash, quite easy) and accept that there are going to be remaining duplicates due to different codecs, bit errors, different cuts, and so on after that.
>>51239686
Hmmm. Has anyone tried to write a script that can rip images from google images based on filter?
That'd probably double the size of my collection if I used my cluster...
automated dump to /s/ you'll be famous
>>51239732
>>51239732
Used to do that before captchas. Does 4chan gold eliminate timers?
>>51239673
Dunno. Generally speaking, anything managed internally as cloud is still equal to any other kind of hosting service, though.
Whoever controls the infrastructure of course can do all sorts of things.
The cloud part mostly is that *they* use some automated software method of keeping data replicated and distributed and online across machines, that's basically all there is to it.
>>51239744
Probably not timers, I forgot about those
>>51239705
Not that i know of, but I'm willing to learn
>>51239758
also /s/ related images are maybe only 10-15% of the total. Most of the /s/ data is video.
>Ctrl + A
>Shift + Del
>Enter
>>51239959
I have an ever-updating local copy of gelbooru, danbooru, and e621.
You really want all of the replicated data to die in a fire?
>>51239993
>and e261
Yes.
Burn all of the five nights at furrys porn.
>>51239529
What's your favorite type to store the most OP? Least favorite?
>>51240274
My favorite type to store? Usually the easiest to obtain. For example, booru sites are easily totally ripped, and they're also easily sorted/updated.
I generally run a rips on schedule every weekend evening.
My least favorite tend to be sites that have the data needlessly sorted in the most complicated ways. For example, a lot of porn sites host the actual data for the videos they stream in some server in god knows where, without even an actual web address. Scripting rips for sites like that is a giant ass-ache because I have to change firewall settings or other things that could interfere with the rips.
Oh and there are also porn sites that don't know how to fucking use cloudflare and other uptime services, so they 504/404 on me randomly because they think my UNIQUE data requests are a fucking ddos.
I don't have any particular taste in specific porn. I am bi/pan -and happily married. Kind of a hobby, I guess.
>>51239562
host an ftp site or similar as a tor hidden service
Just post a screenshot of some of the files I need to know how good the porn quality is.
Genres, ranges? Mostly asian or Western? Amateur or professional? Any siterips? There's a lot to be discussed.
Delete it, anon.
>>51239529
Make a TOR site.
>>51242356
I already mentioned a few of the siterips I have.
Gelbooru
Danbooru
e621
Doujin-moe
>> working on g.e-hentai
>> xhamster, which is still not finished. Only ripping genre's at a time, filtered by popularity/month
I think most of the content is h/s related. Though, this past year, the majority of what I've been collecting has been 3d/aco material. Quality 3D porn has really exploded in quality and quantity in the past few years.
Whenever I see a pornstar thread in /b/ that fancies me, I tend to go try and get the 'discography' of that actor/actoress for my collection.
>>51242356
>>51242428
Oh, and of course I have x-art and suicide girls. Those are WAYYY easier to rip than the shitty porn sites. Everything is neatly organized and easily ripped if you have a member account.
>>51242439
Yo anon , I'm bored and might work on a Google images ripper for u
>>51242474
GL on that, bruh... I imagine it's going to be really fucking convoluted.
Could you figure out a way to pull just the image from the parent site, without loading the entire page -like other rippers? If not, won't be worth it.
>>51242474
>>51242494
Also:
So many of those image hosts have bullshit 2nd click requirements. Like Gimages takes you to the wallpaper site, then makes you click on the god damn thumbnail again to see the actual image, which comes up in some bloated JS image display.
Hey Anon, mind archiving a little bit of 2D porn?
>>51242664
I'll rip Fakku this week.
>>51242673
This is all of their new fancy paid subscription content they released up to November 1st. They've been trying to get it removed and have been sending as many DMCAs as they can.
>>51242712
How does that even work...? Are they licensed by the h circles to profit from their content?
>>51242729
They have licenses from Wani who do X-Eros and Kairakuten. Yes, they still have all their pirated stuff too.
>>51242741
Lol, that's ironic.
got a magnet, so I can get started?
>>51242741
I've been out of the loop far too long. Fakku is licensed? The world has changed.
>>51242753
They DMCA my posts if I do that, it's on sukeibei.nyaa.se, just search for it.
>>51242768
*sukebei
>>51242768
They DMCA your posts... on 4chan... niggawatt
>>51242786
>>51242791
stopped me from posting fappening pics too.
>>51242791
Fucking Christ... Times are a changin'
>>51242815
Fakku/Jacob is also particularly crazy and concerned about it. They tried to get the torrent deleted by convincing one of the mods of the torrent site (who is also their staff) that the artists "were afraid of legal trouble since uncensored porn is illegal in Japan and Nyaa is very popular there".
>>51242835
Still amazes me that people try to keep their porn from being spread for free.
So many sites I've ripped, it was so easy. It's a losing battle...
get a 1TB seedbox somewhere in europe, put 1TB of your files on there and seed them for 3 months or so, until there are enough other seeders. then replace the files with the next 1TB bach of files.
your ip address will only be visible to the seedbox provider.
this is probably the safest and one of the best ways to deal with that amount of data. sftp would be better, though.
>>51242856
He doesn't exactly understand that.
>>51242953
Is he Onta? Because this sounds exactly like Onta/Doxy.
>>51242966
This is Jacob. He's largehotcoffee on twitter. He seems to think his piracy of artists he doesn't have the license over is okay, but my piracy is not (he said he was planning on getting rid of illegal works from his site ever since they started printing physical books)
>>51243006
Lol, yeah -sounds like I need to rip and dupe fakku.
Do you know how large the site is? In GB?
>>51243019
The whole site is probably pretty big, but I don't think the quality is worth it, the only things I ripped were paid stuff that wasn't compressed to hell and back like the rest it.
>>51243019
Excluding the subscription stuff (6.5 GB) there is little point if you already have a panda mirror.
NFI what is and isn't g.e vs panda tho.
>>51243070
I have JBOD free with 12TB of space, probably plenty big enough.
>>51242791
JEWCOB!!!
>>51243070
More in the sense that 98%+ fakku's content can be found in better quality on exhentai.org / g-ehentai.org
The major exception is official work which is either behind the paywall or on sukeibei.nyaa.se
>>51242768
The torrent from sukebei has been removed. I had to get the torrent from Google cache.
>>51243248
It's still up for me.
>>51243248
>>51243260
Sorry, I meant the torrent file.
Oh, fuck OP, you've gotta share that shit, I started collecting from Doujin Moe manually and made it through 2013 and 2014 but I only had access to the free section and some of the links were borked
If you could upload it somewhere, I'd shit my pants
>>51240342
What does your spouse think of your hobby?
>>51242888
Don't forget super seeding.
What are you using to rip OP?
>>51239529
post a pic or webm of ur database anon
>>51243430
That's what this thread is for, lol.
>>51243727
Meh, he knows I have a fuckton of porn. Probably doesn't know how much. He doesn't really care.
>>51245899
httrack, booru grabber, some scripts here and there
torrenting tracked content as well, like keyword searches and then download any updated torrents from the keyword searches
>>51239529
Get a bulletproof hosting and you are set,no dmcing bs for you
>>51246163
If I could find one that was a verified non-NSA honeynet.
Just build a media server pc and turn your porn into a plex server.
Give us the link and bim bam boom.
>>51239562
Hidden service. It's not like there's a rule saying all porn sites on the dark net must be CP
>>51239529
anyone ever wrote a script to hide data in youtube videos?
>>51246535
https://rbt.asia/g/thread/S51079713
Use that YouTube qr code thing that was on /g/
