Use apt-p2p To Improve Ubuntu 9.04 Upgrade
An anonymous reader writes "With Jaunty Jackalope scheduled for release in 12 days on April 23, this blog posting describes how to switch to apt-p2p in preparation for the upgrade. This should help significantly to reduce the load on the mirrors, smooth out the upgrade experience for all involved, and bypass the numerous problems that have occurred in the past on Ubuntu release day. Remember to disable all third-party repositories beforehand."
The site doesn't have much information, but other sources I have read state that apt-p2p is very experimental. Use at your own peril!
Put identity in the browser.
You can also upgrade Ubuntu with an alternate install CD. These can be downloaded via bittorrent, and usually trigger an "automatic update" prompt as soon as they are inserted into an existing Ubuntu system.
I had wondered for a while why yum and apt did not do this by default. It would seem a great ideal. However.... I recently tried to down load fedora 11 alpha via bit torrent using a BT internet connection in the UK. It worked great for about 10Mb (@90-100kb/s), then the download speed gradually ground to a halt. (5kb/s) When I tried a direct download of the same iso the speed bumped back up to a steady 100kb/s. I concluded BT was throttling my bit torrent connection of a legal download to a very slow speed.
So my point is sounds like a great idea but if it is enabled by default it had better have some way to detect bandwidth throttling of p2p networks and revert to http transfer.
mirror here: http://74.125.77.132/search?q=cache:3gY3Bq4EKnMJ:blog.chenhow.net/os/linux/ubuntu/using-apt-p2p-for-faster-upgrades-from-intrepid-to-jaunty/+http://blog.chenhow.net/os/linux/ubuntu/using-apt-p2p-for-faster-upgrades-from-intrepid-to-jaunty&cd=1&hl=nl&ct=clnk&gl=nl
I have yet to have an Ubuntu distro update smoothly, ever. But that won't stop me, onward I will plunge headlong into it with abandon. I don't like my data anyway.
Currently on 8.04, I'll be upgrading to 8.10 sometime after 9.04 is released.
Staying 6 months behind is a reasonable compromise. Let the lab rats (er, enthusiasts!) debug the new stuff first. Last time I checked 8.10 in a VM there was something like 320MB worth of updated packages.
As for the packages themselves, run a local apt proxy like approx, especially if you have more than one Debian or Ubuntu system. It keeps a copy of every .deb you download, and automatically purges the ones that are outdated.
I've used apt-p2p as an apt-get replacement for a short time. It often downloads faster than the standard method but is slower to start downloading. So it's not great when you have many small packages to install. But for a full system upgrade I guess it's a good alternative. Especially on (or close to) launch date when you're sure that update manager will go idle midway through the upgrade. Other alternative is to wait for a week or too after release date when servers are less busy.
What I like about this is not so much the potentially faster upgrade as the ability to contribute a bit to others. The six-monthly upgrades are are rate enough that I don't mind if they are a bit slow - not that they have been. But I am very conscious that I am using other people's freely given bandwidth and I am pleased to be able to give some back.
Does anybody know if I can force my various machines to cross-peer from each other? If I update one first, I don't want the others searching the Net for peers - they should just copy from the first.
Consciousness is an illusion caused by an excess of self consciousness.
I'm concerned that after reading the article, and apt-p2p's FAQ page, that I can't find any guide to how much upload bandwidth this thing will use. While I'm all for sharing, I find it important to cap my upload speed so my connection performs well on other stuff I'm doing, and also stop uploading once I'm at 1:1 sharing or so. Some of us pay if we use too much bandwidth!
Combination - fun iPhone puzzling
p2p is a method used exclusively by criminals, there's no way im going to be using this method.
It worked for me. But in case it really is slashdotted here's the story, from memory (let's test those theories eh?)
"You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
Many primary Linux download sites wind up taking an unreasonable amount of traffic from default setups. If you want to contribute back to the OS's and packages that you find so useful, consider setting up a local mirror to share with the world at large. If you can't justify that, at least consider setting up an internal rsync mirror anytime you have a dozen or more boxes to make updates and downloads much faster for your site, and configure your local machines to point to that local mirror.
This turns out to be especially useful for PXE installaters and cluster setups, for any Linux or other OS. There's nothing like having 100 internal Linux machines all trying to update OpenOffice at the same time from an external primary site, through a corporate DSL line, to ensure that many of the updates will fail.
If it works, why upgrade at all?
Ubuntu 8.04 is a Long Term Support (LTS) release. It will have any security patches until the next LTS release, which is typically every 18 months. So, why not just wait for 9.10?
ws
So does Anonymous Coward have good karma?
I honestly suggest to upgrade when the RC is out (1). That's one week before the actual release date, or in other words Thursday. FYI, when I upgraded to the Alpha 6 I had to download 1.3 GBs; torrenting as much is still going to take a lot of time.
The Release Candidate is typically identical to the "gold" release; also you will help Canonical in testing everything runs as good as it should. If you install apt-p2p (2) you'll even get the warm fuzzy feeling of being a seed for the new packages. :D
The upgrade process is identical -- the only difference is in starting it. Hit Alt-F2 and use "update-manager -d" then hit "Upgrade".
(1) Or hell, upgrade /right now/. I'm using the beta and it is rather stable and experience tells me the beta is always pretty near to what goes gold.
(2) I wouldn't use apt-p2p to upgrade to a dev version as you will find far less peers. However installing it afterwards should let you act as a seed for those packages.
When ideas fail, words become very handy.
Maybe we need slashdot-p2p...
I honestly cannot understand why they don't just release deltas against the old packages. They don't really change greatly between releases and most people do keep a reasonable number of packages in the apt cache. I know it won't work in every single case but maybe only then should they fall back to the full download. Getting the whole thing every time seems hideously inefficient.
Please someone show me where I'm wrong (in a helpful way if you can manage, bonus points for analogies).
Always back up, never back down. ---- Think you're cool 'cos your uid is prime? Take mine, modulo the one digit integers
During the 8.10 upgrade, at some point, the cpu frequency selector will get stuck on the "Ondemand" setting, which during an OS upgrade pretty much means "use all the speed the CPU can give".
On my computer, that meant having it shut off midway the upgrade as I raced to downclock it screaming at policy-tool getting in the way ("I AM &@%!ING ROOT WHAT DO YOU MEAN I AM NOT ALLOWED"). If you need downclocking too, be wary.
I didn't experience this on my 9.04 upgrade to Alpha 5.
</personal-experience></fair-warning>
When ideas fail, words become very handy.
Whoosh.
Mod this +5 Funny so we can see it for the sarcasm it is.
(If it's not sarcasm, of course, you are a sad little man.)
Don't thank God, thank a doctor!
that a site advising the use of p2p to prevent the meltdown of servers has itself been slashdotted.
On a side note : web data and pages themselves could be p2p distributed too, no? Say a peer gets a webpage's hash (containing html and images) and the date/time of expiry for a webpage from a server. If other peers have that page (html+images), and it's up to date, you could download their copy. Otherwise, the server sends a fresh copy to you, and you seed it for others. Not being in computer science, I'm sure this has been proposed before and that there are glaring shortcomings I have missed.
I think it should just be enabled by default, maybe it will take massive legitimate P2P use to force ISPs to stop throttling P2P connections. It's a chicken and egg scenario... do we wait for them to stop throttling P2P to make heavy use of it, or do we make heavy use of it and force ISPs to stop throttling it? I don't think they will just do it out of the kindness of their hearts, so it will take a demonstration to make it happen.
I plan to upgrade directly from the Ubuntu servers, but I'm only going to hit their servers once for the three machines I'm upgrading. I use apt-cacher, which stores packages on the local network once they've been downloaded by something on the network, then sends out the cached version when it's requested again. It doesn't help much for the odd day-to-day package installation, but it makes significant upgrades much faster after the first system. You have to configure all of the systems to use the proxy, but it's easy to setup. If you run more than one or two systems, I'd definitely look into it.
Is Alt-F2 "run" in your shiny little world? It never has been for me, and still isn't. On the other hand, I did use Compiz and gmrun to make Super+R run programs.
"You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
Me too. Often it's quicker to do a full install from scratch.
That's why my systems always have at least two different partitions: one for "/" and another for "/home". I can reformat my system partition and still have my data intact.
I'm not sure why people keep having problems with upgrading their ubuntu machine to newer versions. I have upgraded through most releases (though not always continuously cause for instance i switched to 64 bit recently) and I've never run into any problems really.
I set it up about 6 months ago on my girlfriend's computer, and except for when I'm stealing internet and i've got an intermittent connection, it's worked solidly.
Please stop stalking me, bro.
I was originally planning a full format and reinstall for this release, not only so I could obliterate my Vista partition, but also to take advantage of ext4, which I assume requires a full wipe. Should I just try upgrading in place instead? This news has me reconsidering...
Do what thou wilt shall be the whole of the Law
Here's a link to Google's cached version of the blog, in case anyone still wants to read it: http://tinyurl.com/cspfrq
Yes. I'm sorry your little word isn't as shiny as mine (despite my 3 years old shiny little world has a 1.73 GHz CPU that shuts off when it goes at 1.73 GHz, a non-working firefox-3.0, a malfunctioning usplash, a gedit that doesn't quite like zsh, three failed updates, etc.), but my point is very simple.
If you want to run the latest and greatest software (and you want to run all the risks this takes) you may as well get it a bit sooner than the rest so that you can report bugs before the actual release, and so that you can help balance the network load... provided the thing boots after the release ;)
When ideas fail, words become very handy.
I've tried upgrading with beta a few times, and it can be pretty dicey, especially if you have customised config files or packages from non-Ubuntu repos. Net upgrades have never gone off without some major hitches in my experience. Plus, it's kind of nice to wait for the official release and do some spring cleaning. Net upgrade may be a good idea if you have a box just for experimenting, but I wouldn't recommend it for your daily driver.
Typo: "provided the thing boots after the upgrade."
When ideas fail, words become very handy.
Is it just me or is the fun game of "pick your closest mirror" not very fun at all? Just download the damn thing at best possible speed. I don't care where you get it from.
As if I'm in a position to pick the best site where to download something from. Give me a break. Apologies to the power users who can lick their Ethernet cable and tell which site will have the best download performance and availability.
URL is slashdotted... damnit.
I think using P2P in APT is an unnecessary gimmick. It adds too much overhead and complexity to the mere process of downloading a few packages. Plus the added concern of security. Normal Ubuntu mirrors work just fine. I don't think their bandwidth will really be exhausted any time soon.
Mandriva has been doing torrent releases for years, with great success. The trick is to do an early release to a number of trusted users with good internet connections to act as 'early seeders'.
Please contact the billing/support department as soon as possible. Or at least that's what the link says.
The Tea Party is just the GOP with a bag over its head.
I'm downloading the x64 Jaunty Beta right now via bit torrent at a rate of 2 MB/sec. I'm saturating my 16 Mbps connection :-)
The original link was dead. This is from howtoforge:
http://www.howtoforge.com/ubuntu-using-apt-p2p-for-faster-upgrades-from-hardy-to-intrepid
This sig can be distributed under the LGPL license
Did this with 8.10 and weeks later wondered why some 'bot was chewing my CPU and net bandwidth. The 'bot was of course apt-p2p happily doing the p2p thing. It got annoying enough that I had to be a leecher and uninstall it.
I've never done OS upgrades (Windows or Linux). Do people trust OS upgrades in general and Ubuntu specifically? I figure there is way too many changes, and companies can't afford the needed QA to test all the upgrade scenarios. I'm curious to know what people experience. I guess I might try the Ubuntu upgrade and see what happens (of course I'll always have that nagging feeling, and if any crashes happen I'll probably blame the upgrade).
I'd love to upgrade Ubuntu, but I can't, because there are no working drivers for the SiS video card found in the Intel D201GLY2 motherboard.
The official patched drivers from Intel only work with older versions of Xorg, and nobody has updated Intel's code for the newer version of Xorg.
This bug has been around since at least Hardy. But Hardy had the third-party fix available, and subsequent versions did not. I guess I'm stuck with Hardy.
and according to this bug, "apt-spy is no longer in the Ubuntu repository for releases newer than feisty."
Hopefully clicking this link will stand in for the "apt-get install apt-p2p"
Yep. This is going to be fun.
Help stamp out iliturcy.
Does Steve Ballmer run your ISP?
$META_SIG_JOKE
There's ext4 to be had.. I'm not upgrading, I'm reinstalling.
More great moderation by the "linux can do no wrong" people (this is written on a Linux machine). Anyone want to bet on which Linux distro will be the first to have a windows type virus (without running network services such as bind)? My thoughts are that someday, someone will fuck up and the next "upgrade" you do will result in your being part of a very large bot net, along with all your windows using compatriots.
Now, don't get me wrong, I still won't switch to openbsd. I'd rather use two cans and a string.
switching to apt-p2p was very much slower for me than just using my fastest mirror.
So how does seeding work with this? My upload cap is MUCH lower than my download, so if it only seeds while you are upgrading, I sure wouldn't meet 1.0 ratio (or the 2.0 I usually aim for).
Would it be possible to prefer connections to devices on the same LAN ?
How it the source of a package picked, at random ?