IPFS general - threads keep dying edition.
We got shitloads of roms across many platforms now, neat!
What is IPFS?
A fully decentralized, distributed and encrypted file distribution platform.
>why would one use it
* Distributed and decentralized: no single point of failure, censorship-resistant.
* You can have a mutable address (i.e. always points to the latest version of a site), or a static address (points to a specific file). Yes, you can host sites over IPFS.
* Peers are found fast for new downloads. You don't need to wait that much to start a download.
* You can watch your animu while it downloads, I watched few episodes that way and it didn't even buffer.
Presentation of ipfs by its lead designer:
https://ipfs.io/ipfs/QmSd1buim52M
tQP1SH2XhN7FC8c1K
dFrFKBNmgdUKFdss8/Stanford%20Seminar%20-%20Juan%20Benet%20of%20Protocol%20Labs.webm
(over ipfs)
>how to upload a single file
$ ipfs add ./$file
Access it at localhost:8080/ipfs/$outputted-hash
>how to upload a dir
$ ipfs add -r ./$dir
Access it at localhost:8080/ipfs/$last-outputted-hash
>how to make the thing mutable
$ ipfs name publish ./$file-or-dir-hash
Access it at localhost:8080/ipns/$output-hash-aka-peerid (it's ipNs not ipFs)
To update, publish another hash and it will be available at the same IPNS address.
>gateways (how to access IPFS if you don't have it installed)
https://gateway.ipfs.io/
>I2P and Tor support coming soon™. We need that thing anonymous so pls halp.
https://github.com/ipfs/go-ipfs/issues/1118
https://github.com/ipfs/notes/issues/37
https://github.com/jbenet/go-multiaddr-net/issues/7
>Sites with content on them
/ipns/gindex.dynu.com/ site index
/ipns/QmUqBf56JeGUvuf2SiJNJahAqaVhFSHS6r9gYk5FbS4TAn anime tracker
threadly reminder to pin files that you care about.
>>https://gateway.ipfs.io/
404 not found
>>51581133
You're supposed to put an ipfs url after gateway.ipfs.io/, noob. Such as
gateway.ipfs.io/ipns/gindex.dynu.com/
>>51581133
>>51580795
>gateway.ipfs.io
Ok so i've got it working with just
ipfs.io/ip?s/<hash>
---
Wish i could upload more, too bad my internets a shit
>>51580795
Do anyone have links to full albums? Thinking of doing a music tracker, however my internet is pure shit.
>>51581727
Keep getting 404
>>51581824
We don't have much music yet, would be great if you put something up. Aren't there free hosting services you could use to bootstrap your tracker?
>>51581858
>Aren't there free hosting services you could use to bootstrap your tracker?
Please translate. I'm a bit retarded.
I could put a few albums up, however my internet is 4 down/1 up, and for some reason ipfs seems to be slow. I've uploaded And Justice for All, however I doubt someone could download it.
/ipfs/QmbbA4bQbhG
CUXeF7Da123qMiFZFYyx
WCsNXMVAsU5rxmP
The tracker will be up at /ipns/QmWgsV73KunC6
fHzkkdrcYYr5765Asyu
2ENCyqo5aRo5m6
How can I publish something forever?
>>51582012
For example
https://www.freehosting.com/client/cart.php
or
http://www.weebly.com/features?_escaped_fragment_=/free-web-hosting#!/free-web-hosting
I haven't checked the details and of course you want to be able to run ipfs on the node you get.
>>51582154
But for what exact purpose would I use this hosting for?
>>51582191
To host the files and allow them to be served over ipfs without ruining your bandwidth.
Additionally, neocities now hosts sites over ipfs, so there's that too, you should be able to just upload your files and let neocities host the content for you.
>>51582215
>>51582012
v p s
p
s
Digital ocean is fuck cheap
>>51582498
But not free, that's why I was pointing out free options. If your internet is that bad, you probably don't have the money to upgrade it and thus you probably don't have the money for a DO droplet.
>>51582498
Not really willing to spend money.
You anon might like it more BBS Documentary in OGG Video Format.
/ipfs/QmbzsbCUJY8kbzXKFcKJ7xjTRMod49Ek4Cn6Ccrw5De3ZD
---
IPFS is really fucky in windows btw i've noticed it's much better on linux than it is on my laptop in win 10
Stupid question incoming.
I guess this can apply to file sharing in general, but how are security and privacy maintained when you're giving just about anyone access to files on your system?
>>51582923
You're only giving them access to seperated blocks of a file you explicitly wanted added to your system
so if you upload LeFunnyMeme.jpg at 1mb
And say IPFS breaks it up in to 256k Blocks (idk what it is)
Says your picture identified by ASDFASDCFHASH
When asked for hash ASDFASDCFHASH
Your computer only sends the 4 little 256k blocks that comprise of that file
So nobody has access to the files on your computer unless explicitly given to them
And even then
they have to have the hash of the file, or they cant get it
And because you're only downloading files, even if they brute forced an IPFS hash, they still can't do shit to your computer
TL;DR you're safe and in private (in terms of Filesystem Access)
>>51583133
Thank you :)
Stop dying on me!
>>51585333
okay
>>51585333
>>51585466
What happens when the hashes run out?
>>51585713
>run out of hashes
Literally impossible
If they ever came remotely close i'm sure they'll up it or the successor to IPFS will happen
Literally
Look at QmUqBf56JeGUvuf2SiJNJahAqaVhFSHS6r9gYk5FbS4TAn
Qm is the start of all IPFS links, the rest is the hash, thats 45 charachters,
45 Charachters that can be 0-9,a-z,A-Z 62 possible values per charachters at 45 charachters, is a stupid high amount of combinations
>>51585973
Correction 44 Charachters
44^62 >=5x10^79 (my math may be bad here)
>>51585973
>Literally impossible
Storing all possible permutations of a *kilobit* of data would already have overflown possible combinations by a magnitude of over 200
>>51586763
Yes, obviously, 1000 bits of data is larger than 160 bits of data. Thanks for the insightful remark, broceph. 2^160 is still a fucking huge number.
>>51585973
Pretty sure ipfs uses base58. Because... some men just want to watch the world burn, I guess.
is there any decent index/search engine of files yet?
Something to scrape the DHT for users file collections?
Also how can I contribute with an upload speed of approximately 30kbs?
>>51587400
>Search Engine of Files
That may be hard if not impossible due to the limitations of the network? and also privacy goals of IPFS (Not everything i post i want everyone to have)
Best we can get is a site run on a hybrid of IPFS for static content and something as an API and REST DB
So site run on ipfs, calls http://site/api/search...
effectively like a kickass or TPB clone for IPFS
---
>Also how can I contribute with an upload speed of approximately 30kbs?
Code, bring some new IPFS realiant programs online... if not, bring small stuff, Text, apps, music, something that'll get people interested in dicking around with IPFS...
I get a 1mbps up (but its effectively 800kbps which gives a rough 17kB/s) ... i added Spelunky Classic (You can find it on the gindex), let it go for a while
What i did was added it, downloaded it using the public gateway, so at least something faster than me is sharing it for other people (as it's in the public gateways cache) and at this moment i'm not running ipfs daemon, but you can still download the game because others have.
I'm the guy with the ADSL router from the other thread, and now ipfs appears to work, however it is very slow - opening files takes around 1-2 minutes, pages over 30s. Is this normal?
>mfw ipfs leaks your ip to the other peers
>mfw you are willingly giving "ipfs.io" their ip addresses
>mfw you're literally telling them which illegal files you're about to pirate with your get requests to "ipfs.io"
>>51591020
This.
I don't see the point of IPFS, what problem is it solving? It's just as flawed as bittorrent, releasing your external IP address to peers.
>>51591241
>>51591020
Memetics PhDs pls go.
>>51590773
Wait for your swarm to populate and try again.
>>51591241
It's an easy way to round-robin some content servers. If I were a company and wanted a lazy out for robust access to content I would split a bunch of machines into ipfs nodes and host whatever the company wanted hosted and then put up a few gateways. Then we could be as insane as yahoo and still keep content up for customers, etc. If people actually used ipfs on their own system then we'd have the benefit of them caching the file for us and joining the botnet.
>>51585713
IPFS uses a "multihash" format, meaning the hashed have the hash function and length encoded as part of the hash
... aka, they can change the format whenever without breaking compatibility
https://gateway.ipfs.io/ipns/QmaGks9KKzu2WykHQjJFJkcUAN4ZoF7ok9h2hXj1WQn47U/
Pretty good collection of pages
>>51595828
That's the site pointed to by ipfs.io/ipns/gindex.dynu.com
>>51590773
If you're on windows
Yes
I've noticed IPFS is stupid slow on windows 10 + wifi, but fine on linux
>>51596406
1 0 b o t n e t s
0
b
o
t
n
e
t
s
>>51596406
I'm on Linux.
i might try to host an sorted version of the archive.moe /qa/ image dump soonish on ipfs,no promises though,but it could be fun :)
is it just me,or is the link for the glop.me mirror broken?: http://glop.me/faq.html
>>51597486
also,is there anyone willing to be a peer for this if i do get it up?
>>51595224
Wouldn't that also defeat dedup of the same data across the whole swarm?
>>51598842
No, because you can hash however many times you want and ask for all the corresponding pieces. The point of the multihash isn't to let multiple hashing algorithms be used at the same time, it's to provide a clean upgrade path.
>>51598842
Yes, but they would probably add a command for migrating your datastore and recompute the hashes for all the files you're seeding, if they ever had to upgrade it, so that old nodes can respond to newer hashes of their old files. They would still need to store the old hashes to avoid breaking old links. Not sure how you'd handle new nodes responding to old hashes, though. I guess there are a lot more practical hurdles with upgrading to a new format than just changing the identifier and length of the multihash.
>>51599119
>Not sure how you'd handle new nodes responding to old hashes, though.
Oh, right. They'd just have to compute and store both the SHA2 hash and the one with the new algorithm. Probably not that much of an overhead in imaginary future land.
>>51599234
Or more probably old hashes will simply be "lost" with a new client and vice versa.
>>51599279
But that would defeat the purpose of IPFS: Links should never break. You can't really make everyone change their links to the new hash, especially when the links exist in e.g. an old file or web page made immutable by IPFS.
>>51590773
i have good internet but it still runs like shit
>>51599350
It's a multihash so links can still be followed, even though a v2 client would not be able to cache or produce v1 hashes. Also, changing to a v2 hash is simply a question of running ipfs add -r on your shit that was previously only stored in your v1 hashtable.
>>51599410
Runs great over here with mediocre internet (10 down 1 up).
>>51599418
They can't be followed if nodes don't store the v1 hashes. Or rather, you can send out a request for them, but no one will realize they have the file stored if all they have is a v2 hash.
>>51599441
it has something todo with my install. it ran fine earlier but now its screwed up
>>51599484
Same here. Looks like I'm getting lots of incoming data even after I restart the daemon and before I request a file. Not sure what's going on.
>>51599580
Oh, turns out I had a couple of mpv processes trying to open an IPFS file, but not playing it because the cache wasn't full. That explains the bw stats, but not why it's so slow. There might be something wrong with my network, though. My ISP is pretty retarded.
>>51599645
It can be many things. Some ISPs block or throttle anything that looks like torrent (i.e. anything p2p), or you might be trying to grab content off a single node with slow internet for instance. You can use ipfs dht findprovs <hash> to see how many seeds you'd be using to download a file.
Looks like #ipfs@freenode is monitoring this thread.
>>51600801
That's hilarious
>>51600801
who cares?
>>51600801
shit we've been found out
abandon thread
Migrating hash would indeed cause duplication. The spec says as much. It sounds like a really terrible idea, really.
https://github.com/ipfs/specs/blob/master/protocol/README.md
>All hashes in ipfs are encoded with multihash, a self-describing hash format. The actual hash function used depends on security requirements. The cryptosystem of IPFS is upgradeable, meaning that as hash functions are broken, networks can shift to stronger hashes. There is no free lunch, as objects may need to be rehashed, or links duplicated. But ensuring that tools built do not assume a pre-defined length of hash digest means tools that work with today's hash functions will also work with tomorrows longer hash functions too.
>>51602382
I really don't see the problem. Due to the network's nature, it should be self-maintainable.
idea: how about we make an archive of 4chan on ipfs,that way the best threads would stay up,and the shit would just go into oblivion
>>51603072
4chan was always meant to be ephemeral and archives are a symptom of 4chan's descent to tumblrdom. They were alright when you needed e.g. 7 votes to archive a thread, it's just a publicly hosted version of saving good content. It went to shit after that, though.
The reason why it wouldn't work to manage goodness via ipfs' content-addressed seeding is that the op of a thread, no matter how shit, will always want to seed his shit thread.
>>51603195
maybe so,but when this catches on,we can just filter it to like "if this has more than x number of peers hosting it,bring it up"
>>51580795
>inb4 go back to /v/
Some SCUMMVM Vidya -
QmU7htBPg6GhwCu Qi4ojv1yxxis7iPXwm bWjbPHp7Ahjop/
Ben "Yahtzee" Crowshaws "Chzo Mythos" Series
QmT8m19d3EhqP5kY s4i3TxQpH94eoHKEApd GSXFWFjVzY2
Both are IPFS
Both are trying to get the around the fucking filter
delete the whitespace
>>51580795
Sega Master System
/ipfs/QmWs2Wb7ogmSivrCuAQf
Vw4em269H7q5YELJdjyQpKrjZQ
Sega PICO
/ipfs/QmZv85Q5bjgAyfEYiB4DpX
cknBsmz2JFYgHtRN13oEoUXv
Why is this meme still alive?
>>51600801
https://www.youtube.com/watch?v=erB7i6Uc4DM
>tfw still no ipfs:// browser integration.
Atari 5200 roms
/ipfs/QmfTYKujbYVpb4xA2WPi
p7CN1UpKLj2dizexx86QnVH197
Atari 7800 roms
/ipfs/QmdHCp77UHxwcb3Wxcidh
QKC6HMpuwz3hcnd1aYTczwTMV
Atari Jaguar
/ipfs/QmcmnQcmAkatsn3znukD
BbCiMtmxCJxSZ29i5z9pJbBA3Z
Atari Lynx roms
/ipfs/QmcmnQcmAkatsn3znukD
BbCiMtmxCJxSZ29i5z9pJbBA3Z
Atari ST roms
/ipfs/QmZ3ktrkbC8smaoSCFpr
GU9Y334i78uqZshZWSc8xrc8tx
>>51599119
>>51599234
it's a last restort thing, they don't intent to ever change it, but it's never a bad thing to be safe about it
>>51608051
Well, sure. But they need more of a contingency plan than just changing some fields in newly generated addresses in the event that it does happen, which is what the guy was asking about.
is it possible to get identical hashes from two different files?
>>51608872
Yes, but no one knows how: https://en.wikipedia.org/wiki/Preimage_attack
>>51608872
Nope. That's the point of hashes. Human readable ipns addresses are designed for mutable content like the current state of a blog, but you essentially have the entire git history of every site on IPFS by going directly to the hash URLs.
In case anyone needs an IPv6 http gateway:
http://ipfs.borg.moe/
>>51591241
>OMG A NETWORK DESIGNED FOR END TO END CONNECTIVITY AND PEER TO PEER SHARING OF DATA REVEALS YOUR IP ADDRESS
>STOP THE FUCKING PRESSES
>set up a few simultaneous pin and add commands (thanks tmux) on server running IPFS daemon
>it just hangs for an hour
t-thanks
>>51609100
i2p and freenet doesnt have this problem ;^)
>>51609261
Race condition.
>>51609312
They're also slow, architecturally stupid, and too overrun with kiddie porn to be of much use as a permanent basis for a new web, largely because of the anonymity thing.
>>51609336
You'd think the daemon would at least implement a queue of API requests and handle them in order.
>>51609337
>slow
yes, price for anonymity and lack of peers
>architecturally stupid
nope, tell whats wrong with it
>kiddie porn
yes, but it doent block anyone from hosting normal web page
>>51609076
IPv4 now working too.
Someone mentioned this hash timed out a few threads ago. I restarted my daemon and it seems to work remotely now: /ipfs/QmYc4sWSBMv2EtJ5w
8zefSE9RJ4Krvspw
4FF68XTGdvVKi
Sorry for the late response to whoever asked.
>>51609382
>yes, but it doent block anyone from hosting normal web page
It blocks any serious company from hosting anything, since it means they have to store a repository of someone else's possibly illegal (encrypted) files. Something like Tor or I2P + IPFS divides the problems into an anonymity and application layer, which is a much more sane approach anyway. I agree that anonymity is a democratic necessity, but that's not what IPFS is meant to solve.
>>51611191
Works for me.
>>51609076
I can't connect to it, how recent is the domain?
>>51611847
The domain has been mine for about a year now. That particular A record is a few hours old.
>>51611889
OK, so we probably won't see it for the next day or two.
>>51611892
DNS propagation is fast unless your servers suck. Even Comcast's DNS servers have it.
>>51611921
That's false for the majority of the world.
>>51611892
>>51611937
https://www.whatsmydns.net/#A/ipfs.borg.moe
>up everywhere but India and Malaysia
DESIGNATED SHITTING SERVERS
>>51611921
>>51611937
I'm in the supposedly industrialized part of the world and I still get no dnslink record. I guess I'll have to wait.
>>51612132
>dnslink record
Or A record, I mean.
>>51612151
the dnslink entry has to be a TXT record, not A, by the way.
>>51612105
I'm in NY and I got nothing.
>>51612213
Works for me in the US.
Hey ROMs guy, can you just post a hash for an overall index instead of linking each and every list?
>>51612744
>what is gindex
>>51612744
Bruh. Just use gindex. Also I am taking requests for consoles.
>>51612208
Oh I know, I just misunderstood what we were talking about.
ipfs.borg.moe works here now, by the way.
