feralertx Posted August 24, 2004 Report Share Posted August 24, 2004 Hi everyone, Now that Mandrake has released beta 2 of the upcoming 10.1 I'd like to share this short how-to that explains how to update your beta 1 ISO files using rsync and save some bandwith -and time-. This is probably only aimed to newbies like me who havent heard of it before. I base this mini-how-to on this other one -which i found somehow difficult to follow- and the man pages. 1.- First of all you need to make sure you have installed the package 'rsync'. This is Mandrake's description of the package:Description: Rsync uses a quick and reliable algorithm to very quickly bring remote and host files into sync. Rsync is fast because it just sends the differences in the files over the network (instead of sending the complete files). Rsync is often used as a very powerful mirroring process or just as a more capable replacement for the rcp command. A technical report which describes the rsync algorithm is included in this package. Install rsync if you need a powerful mirroring program. 2.- Then you need to find a mandrake mirror which is rsync enabled. To find out if a specific mirror is offering this service or not you do the following in a console -as regular user-: rsync site.address.com:: And wait for its reply, if you get a welcome message and a list of modules, then you are in bussiness, if not, you need to try another mirror. For this example I did: [mybox]$ rsync ftp.rediris.es:: No luck, this is what i got: rsync: failed to connect to ftp.rediris.es: Connection timed out (110)rsync error: error in socket IO (code 10) at clientserver.c(94) So I tried another one, to see a list of mirrors go to the Mandrakelinux site. [mybox]$ rsync carroll.cac.psu.edu:: Welcome to The Pennsylvania State University / Center for Academic Computing FTP Archives at carroll.cac.psu.edu Due to U.S. Exports Regulations, all cryptographic software on this site is subject to the following legal notice: This site includes publicly available encryption source code which, together with object code resulting from the compiling of publicly available source code, may be exported from the United States under License Exception TSU pursuant to 15 C.F.R. Section 740.13(e). This legal notice applies to cryptographic software only. Please see the Bureau of Export Administration, http://www.bxa.doc.gov/ for more information about current U.S. regulations. Public mirror sites who use our rsyncd may want to contact us for access to a restricted-access rsyncd to better avoid being blocked out. Please send suggestions/comments to ftp@carroll.cac.psu.edu. apache Apache caldera Caldera Linux distribution caldera-iso Caldera Linux distribution ISO images collegelinux Collegelinux Linux distribution cpan Comprehensive Perl Archive Network csw Blastwave.org CSW packages for Solaris ctan Comprehensive Tex Archive Network cygwin Cygwin debian Debian Linux distribution debian-cd Debian Linux distribution CD images fedora-linux-core Fedora Linux Core fedora-linux-core-development Fedora Linux Core Development fedora-linux-core-updates Fedora Linux Core Updates finkinfo freebsd FreeBSD gentoo Gentoo Linux distribution gnome The GNOME ftp site gnu GNU repository kde The KDE ftp site kernel Kernel.org knoppix Knoppix Linux distribution mandrakelinux Mandrake Linux distribution netbsd NetBSD openbsd OpenBSD opencd OpenCD Windows Distribution redhat-redhat Red Hat, Inc. -- Red Hat FTP Site, RedHat Area redhat-ftp Red Hat, Inc. -- Red Hat FTP Site redhat-beta Red Hat, Inc. -- Red Hat Linux beta releases redhat-contrib Red Hat, Inc. -- Contrib FTP Site redhat-rawhide Red Hat, Inc. -- Rawhide FTP Site redhat-updates Red Hat, Inc. -- Updates FTP Site sgifreeware freeware.sgi.com slackware Slackware Linux distribution sorcerer Sorceror Linux distribution splack Splack Linux distribution sunfreeware ftp.sunfreeware.com suse SuSE Linux distribution xfree86 XFree86 ximian Ximian GNOME yellowdog YellowDog Linux distribution There you go, that is the list of the rsync modules they are offering. You can see 'mandrakelinux' among them, so now we do: [b][mybox]$ rsync carroll.cac.psu.edu::mandrakelinux[/b] [Welcome message has been omitted...] drwxr-xr-x 4096 2004/08/24 19:31:17 . -rw-r--r-- 991 2004/04/08 10:07:54 README drwxr-xr-x 4096 2004/08/24 19:00:32 devel drwxr-xr-x 4096 2004/04/14 08:16:30 official drwxr-xr-x 4096 2004/04/01 18:47:10 old Those are the directories they are offering. At the time of writing, the isos are located in '/devel/iso/10.1/i586/' (all mirrors should have the same directory structure). To make sure you can always use an ftp client to connect to the ftp site and find out the real path to the isos -and find out their new filenames too-. Ok so '/devel/iso/10.1/i586' is the directory and these are the filenames for beta 2: Mandrakelinux-10.1beta2-CD1.i586.iso Mandrakelinux-10.1beta2-CD2.i586.iso Mandrakelinux-10.1beta2-CD3.i586.iso 3.- Rsync needs you to rename your old filenames (those of beta 1) to those of the new isos. So cd to the local directory where you keep the old isos and change their name to match those of beta 2: cd /cooker --> (change /cooker to your local directory where the old isos are) mv Mandrakelinux-10.1beta1-CD1.i586.iso Mandrakelinux-10.1beta2-CD1.i586.iso mv Mandrakelinux-10.1beta1-CD2.i586.iso Mandrakelinux-10.1beta2-CD2.i586.iso mv Mandrakelinux-10.1beta1-CD3.i586.iso Mandrakelinux-10.1beta2-CD3.i586.iso 4.- Ok, now we just need to give the rsync command: rsync -P --stats carroll.cac.psu.edu::mandrakelinux/devel/iso/10.1/i586/Mandrakelinux-10.1beta2-CD[1-3].i586.iso . The command explained: -P --> Tells rsync to keep partially transferred files and to print information showing the progress of the transfer. --stats --> This tells rsync to print a verbose set of statistics on the file transfer, allowing you to tell how effective the rsync algorithm is for your data. carroll.cac.psu.edu::mandrakelinux/devel/iso/10.1/i586/Mandrakelinux-10.1beta2-CD[1-3].i586.iso --> This are the files to rsync, as the 3 files do have the same name and only change in the CD number 1,2 and 3, we use [1-3] with the same result and saving the pain to write the command 3 times (one per file), this way it does one file after the other. In case you want to make it one by one just change [1-3] for the iso number 1, 2 or 3. . --> This is the directory where the isos to rsync are, as i was in that very same dir, I just use “.” which is equivalent to the 'working directory'. We'll see some verbose on the console like filename being updated, downloading speed, time to finish etc. Once it finishes all files will give you some stadistics: Mandrakelinux-10.1beta2-CD1.i586.iso 681025536 100% 135.34kB/s 1:21:54 Mandrakelinux-10.1beta2-CD2.i586.iso 681598976 100% 49.66kB/s 3:43:24 Mandrakelinux-10.1beta2-CD3.i586.iso 678737920 100% 32.81kB/s 5:36:42 Number of files: 3 Number of files transferred: 3 Total file size: 2041362432 bytes Total transferred file size: 2041362432 bytes Literal data: 1092912440 bytes Matched data: 948449992 bytes File list size: 97 Total bytes written: 517536 Total bytes read: 1040346681 wrote 517536 bytes read 1040346681 bytes 26868.99 bytes/sec total size is 2041362432 speedup is 1.96 I'm on 256/128 DSL, so it usually takes me about 6-7 hours to download one 700 Mb ISO image, as you can see the time has been greatly reduced using rsync. As you can see in the stats the first iso took only 1:21:54, but that is becuase I had to stop rsync and I continued later. I see rsync as a great tool and dont know why other mirrors do not use it. I must say that is only useful if the isos havent changed much between them (for example beta1 and beta2), but if they are absolutly different (like mdk 9.2 and 10.0 isos are) then rsync wont help much and very likely will have to download the whole file. Hope it helps. Comments, corretions and suggestions welcome! [moved from Installing Mandrake by spinynorman] Quote Link to comment Share on other sites More sharing options...
papaschtroumpf Posted August 24, 2004 Report Share Posted August 24, 2004 (edited) cool, but I think I'll wait till the official version comes out. By the way is there a "roadmap" for future releases? Edited August 24, 2004 by papaschtroumpf Quote Link to comment Share on other sites More sharing options...
Guest anon Posted August 24, 2004 Report Share Posted August 24, 2004 This is already covered here But its often forgotten so thanks for the reminder. As a side note, don't bother using the -z option. The files are already compressed. Quote Link to comment Share on other sites More sharing options...
feralertx Posted August 25, 2004 Author Report Share Posted August 25, 2004 This is already covered hereBut its often forgotten so thanks for the reminder. Ooops! I should have looked in that forum before posting and could've save some time , anyway, as you say, if it helps to remind some people and to introduce rsync to some others, then it is time well spend. As a side note, don't bother using the -z option. The files are already compressed. Ah all right, thanks, i didnt know. I have removed it now from the original post. Cheers!!! Quote Link to comment Share on other sites More sharing options...
ac_dispatcher Posted September 5, 2004 Report Share Posted September 5, 2004 feralertx - Your on dsl and take 6-7 hours for 1 700mb cd? How fast is your download speed? Im on dsl and its takes me about 1 1/2 - 2 hours to download a cd @ 165k a second. Quote Link to comment Share on other sites More sharing options...
feralertx Posted September 5, 2004 Author Report Share Posted September 5, 2004 feralertx - Your on dsl and take 6-7 hours for 1 700mb cd? How fast is your download speed? Im on dsl and its takes me about 1 1/2 - 2 hours to download a cd @ 165k a second. <{POST_SNAPBACK}> I'm on a pathetic 256/128 dsl connection, with a maximum (average) of 27 KB/sec download speed , for wich i pay 45€ (about 50$) They are gonna double download speed (while mantaining upload to 128 :wacko: ) without a price increase :lol: in the next months ... still expensive though... If yours d/l at 165k (=KB??) then you're probably using a 2MB connection, right ? Quote Link to comment Share on other sites More sharing options...
ac_dispatcher Posted September 5, 2004 Report Share Posted September 5, 2004 Nope. Im pretty sure its a 128k According to my price plan: Speed: 384Kbps-1.5Mbps downstream/128Kbps upstream Monthly Fee $26.95 PM me for some more info on it. Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.