Report forwarded to debian-bugs-dist@lists.debian.org, Philip Hands <phil@hands.com>:
Bug#84333; Package rsync.   debian-bugs-dist@lists.debian.orgPhilip Hands  Subject: Bug#84333: for speeding up partial downloads Reply-To: Chris Danis , 84333@bugs.debian.org Resent-From: Chris Danis Resent-To: debian-bugs-dist@lists.debian.org Resent-CC: Philip Hands Resent-Date: Thu, 01 Feb 2001 03:04:08 GMT Resent-Message-ID: Resent-Sender: owner@bugs.debian.org X-Debian-PR-Message: report 84333 X-Debian-PR-Package: rsync X-Debian-PR-Keywords: X-Loop: owner@bugs.debian.org Received: via spool by bugs@bugs.debian.org id=B.98099430928781 (code B ref -1); Thu, 01 Feb 2001 03:04:08 GMT X-Mailer: exmh version 2.2 06/23/2000 (debian 2.2-1) with nmh-1.0.4+dev From: Chris Danis To: submit@bugs.debian.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Wed, 31 Jan 2001 21:33:26 -0500 Message-Id: Delivered-To: submit@bugs.debian.org Package: rsync Severity: wishlist Many times, when one is downloading a large file, the transfer gets interrupted for one reason or another. What if rsync could: 1) Compare file sizes between server and client, and for whichever one is smaller (call this computer A), look at that much of the file on the end with the larger file (call this computer B). In other words, take computer A's file and compare the md5sum (or initially, Adler32) against the first however many bytes of computer's B file (as determined by filesize on computer A). This treats the portion of the file already on computer A as one chunk, meaning only one checksum must be computed and sent over the wire. Possibly, rsync (on each end) could internally still break it apart, to take advantage of redundancies (but even with this, checksums of these internally-computed blocks do not have to be sent over the wire). 2) If they match, continue onwards (with the normal blocksize and whatnot) from that point. This could save much time(/bandwidth) computing, sending, and comparing lots of small checksums. If they don't match, rsync can just work as normal. -chris -- "Meat. They're made out of meat." "It's better than bad, it's good!" (I subscribe to all lists that I post to; please do not Cc me) Chris Danis screech@mad.scientist.com screechco@home.com dadanish@usa.net   Acknowledgement sent to Chris Danis <screechco@home.com>:
New Bug report received and forwarded. Copy sent to Philip Hands <phil@hands.com>.   -t  From: owner@bugs.debian.org (Debian Bug Tracking System) To: Chris Danis Subject: Bug#84333: Acknowledgement (for speeding up partial downloads) Message-ID: In-Reply-To: References: X-Debian-PR-Message: ack 84333 Thank you for the problem report you have sent regarding Debian. This is an automatically generated reply, to let you know your message has been received. It is being forwarded to the developers mailing list for their attention; they will reply in due course. Your message has been sent to the package maintainer(s): Philip Hands If you wish to submit further information on your problem, please send it to 84333@bugs.debian.org (and *not* to bugs@bugs.debian.org). Please do not reply to the address at the top of this message, unless you wish to report a problem with the Bug-tracking system. Darren Benham (administrator, Debian Bugs database)   Received: (at submit) by bugs.debian.org; 1 Feb 2001 02:25:09 +0000 From screechco@home.com Wed Jan 31 20:25:09 2001 Return-path: Received: from femail8.sdc1.sfba.home.com [::ffff:24.0.95.88] by master.debian.org with esmtp (Exim 3.12 1 (Debian)) id 14O9Qq-0007U9-00; Wed, 31 Jan 2001 20:25:08 -0600 Received: from brooks.homenet ([24.18.239.121]) by femail8.sdc1.sfba.home.com (InterMail vM.4.01.03.00 201-229-121) with ESMTP id <20010201022507.GVLT26894.femail8.sdc1.sfba.home.com@brooks.homenet> for ; Wed, 31 Jan 2001 18:25:07 -0800 Received: from localhost ([127.0.0.1] helo=brooks ident=danish) by brooks.homenet with esmtp (Exim 3.22 #1 (Debian)) id 14O9Ys-00010n-00 for ; Wed, 31 Jan 2001 21:33:26 -0500 X-Mailer: exmh version 2.2 06/23/2000 (debian 2.2-1) with nmh-1.0.4+dev From: Chris Danis To: submit@bugs.debian.org Subject: for speeding up partial downloads Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Wed, 31 Jan 2001 21:33:26 -0500 Message-Id: Delivered-To: submit@bugs.debian.org Package: rsync Severity: wishlist Many times, when one is downloading a large file, the transfer gets interrupted for one reason or another. What if rsync could: 1) Compare file sizes between server and client, and for whichever one is smaller (call this computer A), look at that much of the file on the end with the larger file (call this computer B). In other words, take computer A's file and compare the md5sum (or initially, Adler32) against the first however many bytes of computer's B file (as determined by filesize on computer A). This treats the portion of the file already on computer A as one chunk, meaning only one checksum must be computed and sent over the wire. Possibly, rsync (on each end) could internally still break it apart, to take advantage of redundancies (but even with this, checksums of these internally-computed blocks do not have to be sent over the wire). 2) If they match, continue onwards (with the normal blocksize and whatnot) from that point. This could save much time(/bandwidth) computing, sending, and comparing lots of small checksums. If they don't match, rsync can just work as normal. -chris -- "Meat. They're made out of meat." "It's better than bad, it's good!" (I subscribe to all lists that I post to; please do not Cc me) Chris Danis screech@mad.scientist.com screechco@home.com dadanish@usa.net   Bug closed, send any further explanations to Chris Danis <screechco@home.com> Request was from Chris Danis <danish@debian.org> to control@bugs.debian.org.   Received: (at control) by bugs.debian.org; 31 Mar 2002 02:15:19 +0000 From danish@debian.org Sat Mar 30 20:15:19 2002 Return-path: Received: from mail01g.rapidsite.net [207.158.192.232] by master.debian.org with smtp (Exim 3.12 1 (Debian)) id 16rUsJ-0005xD-00; Sat, 30 Mar 2002 20:15:19 -0600 Received: from www.mercom.com (207.158.228.204) by mail01g.rapidsite.net (RS ver 1.0.62s) with SMTP id 030532 for ; Sat, 30 Mar 2002 21:12:20 -0500 (EST) Received: from localhost ([127.0.0.1] helo=brooks ident=danish) by brooks.homenet with esmtp (Exim 3.35 #1 (Debian)) id 16rUsQ-0000hl-00 for ; Sat, 30 Mar 2002 21:15:26 -0500 X-Mailer: exmh version 2.5 07/13/2001 (debian 2.5-1) with nmh-1.0.4+dev From: Chris Danis To: control@bugs.debian.org Subject: changing bugs to new email address Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Sat, 30 Mar 2002 21:15:26 -0500 Message-Id: X-Loop-Detect: 1 Delivered-To: control@bugs.debian.org close 103771 reopen 103771 danish@debian.org close 109165 reopen 109165 danish@debian.org close 127150 reopen 127150 danish@debian.org close 84333 reopen 84333 danish@debian.org close 109841 reopen 109841 danish@debian.org close 117397 reopen 117397 danish@debian.org close 126836 reopen 126836 danish@debian.org thanks Just changed the old @home email (which no longer works) to my debian.org account. -- (I subscribe to all lists that I post to; please do not Cc me on list reply) Chris Danis chris.danis@mercom.com / danish@debian.org Debian GNU/Linux - www.debian.org   Bug reopened, originator set to danish@debian.org. Request was from Chris Danis <danish@debian.org> to control@bugs.debian.org.   Received: (at control) by bugs.debian.org; 31 Mar 2002 02:15:19 +0000 From danish@debian.org Sat Mar 30 20:15:19 2002 Return-path: Received: from mail01g.rapidsite.net [207.158.192.232] by master.debian.org with smtp (Exim 3.12 1 (Debian)) id 16rUsJ-0005xD-00; Sat, 30 Mar 2002 20:15:19 -0600 Received: from www.mercom.com (207.158.228.204) by mail01g.rapidsite.net (RS ver 1.0.62s) with SMTP id 030532 for ; Sat, 30 Mar 2002 21:12:20 -0500 (EST) Received: from localhost ([127.0.0.1] helo=brooks ident=danish) by brooks.homenet with esmtp (Exim 3.35 #1 (Debian)) id 16rUsQ-0000hl-00 for ; Sat, 30 Mar 2002 21:15:26 -0500 X-Mailer: exmh version 2.5 07/13/2001 (debian 2.5-1) with nmh-1.0.4+dev From: Chris Danis To: control@bugs.debian.org Subject: changing bugs to new email address Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Sat, 30 Mar 2002 21:15:26 -0500 Message-Id: X-Loop-Detect: 1 Delivered-To: control@bugs.debian.org close 103771 reopen 103771 danish@debian.org close 109165 reopen 109165 danish@debian.org close 127150 reopen 127150 danish@debian.org close 84333 reopen 84333 danish@debian.org close 109841 reopen 109841 danish@debian.org close 117397 reopen 117397 danish@debian.org close 126836 reopen 126836 danish@debian.org thanks Just changed the old @home email (which no longer works) to my debian.org account. -- (I subscribe to all lists that I post to; please do not Cc me on list reply) Chris Danis chris.danis@mercom.com / danish@debian.org Debian GNU/Linux - www.debian.org