https://archive.org/details/4chanThreadDump
this is the first segment of more than 100GB of collected threads, mostly porn, memes, opinions, and current events.
thanks
>>693530
also, none of it has gone through deduplication yet, software recommendations are appreciated
Which board(s)?
Also getting a tracker error (torrent not allowed) on the torrent, and there are no seeds on the DHT.
WTF, OP.
>>693558
it could be that it's appending the archive.org stuff to the end of it if you're clicking a link and not copy/pasting raw text
>>693571
Did it work for you or are you just making random guesses? Because the torrent loaded fine, just the tracker rejects it and there are no seeds.
>>693531
>linux
>fdupes -r -d -N /path/to/directory
done.
Don't use -N if you want to see each file that will be deleted
Does anyone else have their torrent client crash if they try to open the torrent file? I'm on uTorrent 2.2.1
>>693531
I compared md5 hashes. Bunch of programs can do it.
Haven't tried it but this can compare similar images, it seems.
http://duplifinder.codeplex.com/
>>694865
>using uBotnet
kek'd
Seed plz.
There are no seeders.
bump.
2982 duplicates found out of 94106
It was taken off archive.org anyone got the magnetic link?
has been taken down, bumping for OP
>>693530
re-up OP
Someone post the magnet link, please.
bamp
bump re-up pls
bumperino
>>705511
It's dead faggots except it
Someone repost pls
>>694895
>http://duplifinder.codeplex.com/
Neat app.
