Trackerless BitTorrent Beta Posted 432
jgarzik writes "BitTorrent development is occuring at a furious pace. At the beginning of May, an Azureus update added distributed tracker and database features. Yesterday, Bram updated BitTorrent to include support for trackerless torrents in the new BitTorrent 4.10 beta."
Re:So... (Score:5, Informative)
Easy, it's the same, but different (Score:2, Informative)
It's the same basic method, just now the actually torrent mechanicans are now on the peer instead of the server.
Re:Hmm... (Score:4, Informative)
Since TFA is a bit short on details... (Score:5, Informative)
Re:So... (Score:5, Informative)
Here is the bittorrent.com explanation:
***
BitTorrent Goes Trackerless: Publishing with BitTorrent gets easier!
As part of our ongoing efforts to make publishing files on the Web painless and disruptively cheap, BitTorrent has released a 'trackerless' version of BitTorrent in a new release.
Suppose you bought a television station, you could broadcast your progamming to everyone in a 50 mile radius. Now suppose the population of your town tripled. How much more does it cost you to broadcast to 3 times as many people? Nothing. The same is not true of the Web. If you own a website and you publish your latest video on it, as popularity increases, so does your bandwidth bill! Sometimes by a lot! However, thanks to BitTorrent the website owner gets almost near-broadcast economics on the web by harnessing the unused upstream bandwidth of his/her users.
In prior versions of BitTorrent, publishing was a 3 step process. You would:
1. Create a ".torrent" file -- a summary of your file which you can put on your blog or website
2. Create a "tracker" for that file on your webserver so that your downloaders can find each other
3. Create a "seed" copy of your download so that your first downloader has a place to download from
Many of you have blogs and websites, but dont have the resources to set up a tracker. In the new version, we've created an optional 'trackerless' method of publication. Anyone with a website and an Internet connection can host a BitTorrent download!
While it is called trackerless, in practice it makes every client a lightweight tracker. A clever protocol, based on a Kademlia distributed hash table or "DHT", allows clients to efficiently store and retrieve contact information for peers in a torrent.
When generating a torrent, you can choose to utilize the trackerless system or a traditional dedicated tracker. A dedicated tracker allows you to collect statistics about downloads and gives you a measure of control over the reliability of downloads. The trackerless system makes no guarantees to reliability but requires no resources of the publisher. The trackerless system is not consulted when downloading a traditionally tracked torrent.
Although still in Beta release, the trackerless version of BitTorrent, and the latest production version are available at http://www.bittorrent.com/ [bittorrent.com]
Re:Diluting its strengths? (Score:5, Informative)
Hopefully... allowing more people to post more content is one of the project's goals.
With the increase of different torrents everywhere, won't that dilute the power of BT?
No, because the uploaders for a given file consist only of the people who have previously downloaded that file. So no matter how many files are "out there", the total bandwidth available to distribute any particular file is always proportional to the number of people interested in that file.
File-A's popularity won't leech bandwidth from File-B's swarm, because File-B's swarm wasn't providing any bandwidth for File-A in the first place.
Application of DHTs (Score:4, Informative)
If you are interested in how it works, you can check out http://en.wikipedia.org/wiki/Distributed_hash_tab
Re:So... (Score:2, Informative)
The starting point if the client that starts to seed first. Everybody connect to you to know where to go next. You don't get as much request as a regular tracker though since after the first contact with you, the other clients know who else they can contact.
You can also republish a
Like Bittorrent (Score:1, Informative)
http://www.bittorrent.com/donate.html [bittorrent.com]
Re:BitTornado. The difference? (Score:2, Informative)
Re:How (Score:5, Informative)
Nodes randomly generate either 128 or 160 bit node identifiers. An identifier uniquely identifies a node on the network. Traditionally, they are computed as just the MD5 or SHA-1 hash of your IP address (this is to make it harder for clients to select exactly what identifier they want, which could help them target certain files for takedown... more on that later).
In Kademlia, the idea is that messages routed through the network are identified by a message key. This is, as well, either a 128 or 160 bit value. The goal of Kademlia, and every other DHT (Google for Chord, CAN, Pastry, etc.) is to route a message to the node whose identifier is "closest" to the message key. In Kademlia, the distance between a node identifier and another node identifier, or a node identifier and a message key, is computed by simply XORing the two and treating the result as an unsigned integer.
Each node maintains (roughly) a routing table containing nodes that match successively-longer high order bits with itself. For example, node 0100... maintains an entry to a node starting with 1..., a node starting with 00..., a node starting with 011..., and a node starting with 0101... Note that in terms of distance by XOR, the first node has a distance of 1..., the second with a distance of 01..., and so forth. Thus, nodes matching more high order bits are closer to you in the identifier space.
So if you are node 1010... and you receive a message starting with 0111... You should have some node in your routing table that differs in the highest-order bit, that is, it starts with 0... Say its node identifier starts with 0000. You route the message to that node. If you compute the XOR between your node identifier and the key, and this node's identifier and the key, you will see that this node is approximately twice as close to the key as you are.
Now this node differs in the second bit: 0000 vs 0111. In its routing table, it must have some node that matches in the first bit, and differs in the second: that is, starting with 01... If the message is routed to that node, we again cut our distance to the key by approximately 1/2. This process repeats until we find the node "closest" to the message key.
Routing in this manner takes log(N) time, and each node on the network maintains log(N) connectivity. Note that there are well-established algorithms for nodes joining and leaving the network, of which the former takes log(N) time as well.
So how does BitTorrent fit in? Here's what I'm assuming: Each
You can do other neat tricks, too, like keyword searching, load balancing, and whatnot (see eMule -- it uses the Kademlia DHT for its serverless system). Other DHTs work in a similar manner. I'm a little confused as to why everyone uses Kademlia, when there are better ones out there. (Accordian [mit.edu], for example, is truly state-of-the-art.)
Plenty of resources on DHTs can be found at Project Iris [project-iris.net].
- shadowmatter
Re:There still is a target (Score:2, Informative)
Re:Is this REALLY Bram's site? (Score:2, Informative)
Domain name: BITTORRENT.COM
Administrative Contact:
Cohen, Bram bram@bitconjurer.org
Re:How (Score:3, Informative)
What does this mean? How can you not have access to your own machine?
Anyway, YOU STILL HAVE TO RUN A TRACKER. It's just built in to the client instead of being the program right next to it. It does have minor advantages in traffic generated at the original tracker (which is pretty insignificant anyway), and in being able to resume a download after the original tracker dies. However, you can't start a new download after the tracker dies (which is what we really wanted trackerless torrents for) unless someone posts an updated version of the torrent file with peers that are still active.
Updaters (Score:2, Informative)
You would need a bittorrent client to be able to use a torrent so it will be ironic that there would be a torrent.
You're talking about the issue of a first-time installation, while grandparent is talking about an updater. For instance, Azureus and eMule installers are both available through HTTP download for first time users, but Azureus's built-in updater uses BT protocol to distribute the updated jar files, and you can get eMule updates through ed2k protocol as well.
Re:How does it work? (Score:3, Informative)
Bittorrent isn't intended to protect your identity. It never was. The fact that it's commonly used for activities that might get people in trouble is just due to lack of a poweful, easy-to-use solution in the arena of programs that do protect your identity (see: Freenet [freenetproject.org], Tor [eff.org], and MUTE [slashdot.org]), and possibly in part to bad planning on the part of an increasingly fragmented and confused base of illegal file-sharers.
Re:So... (Score:3, Informative)
Re:How (Score:4, Informative)
Re:Diluting its strengths? (Score:4, Informative)
Lets say you and I both recorded the latest Britney_Spears story on ET. We each grabbed from the first frame of the story as our recordings captured it, to the last frame of the story. It happens the there was a comercial break in the middle of the story, which we have each clipped out. However our clips are not identical, and if we are both capturing from an analog source, our actual files will be different. Even if we both share the file as 'ETBritneyInterview.mpeg2' our file hashes will be different, so there will be no collision.
Next up... Joe is a fan of Ubuntu Linux, and tracks down an ISO file for it. Puts it on his web server with a
Last up, I create an ISO for some new distribution of Linux, and create a trackerless
Hope that addresses your question.
-Rusty
Re:wryy (Score:3, Informative)
It is not clear whether the official BT client works in the same way or whether it is compatible with Azureus.
Re:Won't stop the RIAA/MPAA (Score:2, Informative)
Re:So... (Score:2, Informative)
You still need a torrent file, you just don't have to set up a tracker now, just open your client, like you'd normally do for Kazaa or other file sharing programs.
No you dont, a magnet link [sourceforge.net] like the ones for gnutella clients will do fine. You still can`t search like on e-donkey/gnutella and other napster alikes. Ofcourse some prefere files where others vouched for their quality. Anyway, its just waiting until hash values become a standard part of a release groups NFO files.
BT, Azureus & Mainline use the same protocol (Score:2, Informative)
Apparently BitTorrent, Azureus and Mainline all use the same protocol.
BitTorrent: Azureus: Mainline/khashmir: Emphasis mine.Re:So...Idle Hands are... (Score:2, Informative)
True anonymous p2p filesharing will never be possible - it is ALWAYS possible to find out who you are downloading from. Accept it.
Re:Diluting its strengths? (Score:3, Informative)
Unlike more inefficent protocols, BT choose to implement basic game theory into the design. While it is not nescessary for a client to implement the tit-for-tat algorithm (see prisoner's dilemma), pretty much all do because not implementing it would make the client work less efficently in the BT network.
Other p2p networks try to reward uploading in different ways, but all those ways are far less efficent than using the basics learned from the prisoner's dilemma.
Re:Is this REALLY Bram's site? (Score:2, Informative)
Yes [bittorrent.com]
Re:Losing Centralized tracker is not good (Score:5, Informative)
Re:Diluting its strengths? (Score:3, Informative)
"Clients only share the same bandwidth if they used the same
Re:Losing Centralized tracker is not good (Score:5, Informative)
Bittorrent isn't a "share all the files on my hard drive" system. It's a distribution system for content publishers. It will most likely never be the former because that's how you get the MPAA, RIAA, etc on your back. If you want a list of content publishers use Google.
Also the Emule has it better that it can determine that multiple names of a file are actually the same file, based on the same Hash.
There's never any danger of downloading multiple versions of the same file because you download the torrent file from the publisher's website - not the system. That torrent connects you to one or more peers, the mini-trackers, which are presumably operated by the publisher. And then it's just standard bittorrent stuff.
It's good way to publish legitimate content. It's not a good way to distribute illegal content. First of all the torrent has a record of your peer IP addresses. So, all the lawyers need to do is have the peers listed in the torrent shut down -- then the torrent is useless. Sure, you could hide for a while using zombie windows boxes as your "master" peers, that's one level of indirection. But as they become unavailable you need to distribute new torrent files with fresh peer lists. Maybe that's not a problem, but it seems like more trouble than it's worth.
If you want a share-all-my-files p2p bittorrent, try eXeem (or eXeem Lite).