CRC of an out-of-order arrival data.
CASTalk.com Forum Index CASTalk.com
Discussion of DSP, FPGA, storage and embedded system.
 
 FAQFAQ   MemberlistMemberlist     RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 
 
Google
 
Web castalk.com
CRC of an out-of-order arrival data.

 
Post new topic   Reply to topic    CASTalk.com Forum Index -> Storage System
Author Message
alpha
Guest





Posted: Tue Aug 16, 2005 12:16 am    Post subject: CRC of an out-of-order arrival data. Reply with quote

Hi;

I figured out a method to calculate accumulated CRC of data when its
packet arrival is out of order without large intermediate data buffer.
In aother word, I can calculate each packet's contribution to the final
CRC using each packet's CRC which could be give by hardware or protocal
chip. The overhead is little and the complexity is O(N), where N is the
packet number. By this method, what ever implemented in software or
hardware, it can potentially save lot of buffer space, CRC engine and
huge memory bandwidth. I thought iSCSI storage system could be a ideal
application candidate. I do not know if this one has some real value or
be implemented alreday. Any comment or feedback is welcome!
Back to top
Rob Turk
Guest





Posted: Tue Aug 16, 2005 8:16 am    Post subject: Re: CRC of an out-of-order arrival data. Reply with quote

"alpha" <zhg.liu@gmail.com> wrote in message
news:1124150106.352296.268030@g44g2000cwa.googlegroups.com...
Quote:
Hi;

I figured out a method to calculate accumulated CRC of data when its
packet arrival is out of order without large intermediate data buffer.
In aother word, I can calculate each packet's contribution to the final
CRC using each packet's CRC which could be give by hardware or protocal
chip. The overhead is little and the complexity is O(N), where N is the
packet number. By this method, what ever implemented in software or
hardware, it can potentially save lot of buffer space, CRC engine and
huge memory bandwidth. I thought iSCSI storage system could be a ideal
application candidate. I do not know if this one has some real value or
be implemented alreday. Any comment or feedback is welcome!


If you can demonstrate the cases where this is useful, write an
implementation and submit it to the iSCSI Linux developers. I'm sure that if
you have strong arguments, they will add it to their code for inclusion.

Rob
Back to top
Maxim S. Shatskih
Guest





Posted: Tue Aug 16, 2005 8:16 am    Post subject: Re: CRC of an out-of-order arrival data. Reply with quote

Out of order arrival is usually a sign of a packet being lost, which is -
in TCP - usually due to congestion on the router. Such things are very rare on
iSCSI.

--
Maxim Shatskih, Windows DDK MVP
StorageCraft Corporation
maxim@storagecraft.com
http://www.storagecraft.com

"alpha" <zhg.liu@gmail.com> wrote in message
news:1124150106.352296.268030@g44g2000cwa.googlegroups.com...
Quote:
Hi;

I figured out a method to calculate accumulated CRC of data when its
packet arrival is out of order without large intermediate data buffer.
In aother word, I can calculate each packet's contribution to the final
CRC using each packet's CRC which could be give by hardware or protocal
chip. The overhead is little and the complexity is O(N), where N is the
packet number. By this method, what ever implemented in software or
hardware, it can potentially save lot of buffer space, CRC engine and
huge memory bandwidth. I thought iSCSI storage system could be a ideal
application candidate. I do not know if this one has some real value or
be implemented alreday. Any comment or feedback is welcome!
Back to top
alpha
Guest





Posted: Tue Aug 16, 2005 4:16 pm    Post subject: Re: CRC of an out-of-order arrival data. Reply with quote

The issue is system need buffer arrival data until they were all
received since they could come out-of-order, even it is rare as you
mention. Then system need read them out to verify CRC, which took
memory bandwith too.

It will be great if storage system only save each packet's contribution
to the final CRC and commit this packet's data immediately. Util all
packets were received, verify over all CRC. No intermediate buffer for
data in this approcah. This is the point.






Maxim S. Shatskih wrote:
Quote:
Out of order arrival is usually a sign of a packet being lost, which is -
in TCP - usually due to congestion on the router. Such things are very rare on
iSCSI.

--
Maxim Shatskih, Windows DDK MVP
StorageCraft Corporation
maxim@storagecraft.com
http://www.storagecraft.com

"alpha" <zhg.liu@gmail.com> wrote in message
news:1124150106.352296.268030@g44g2000cwa.googlegroups.com...
Hi;

I figured out a method to calculate accumulated CRC of data when its
packet arrival is out of order without large intermediate data buffer.
In aother word, I can calculate each packet's contribution to the final
CRC using each packet's CRC which could be give by hardware or protocal
chip. The overhead is little and the complexity is O(N), where N is the
packet number. By this method, what ever implemented in software or
hardware, it can potentially save lot of buffer space, CRC engine and
huge memory bandwidth. I thought iSCSI storage system could be a ideal
application candidate. I do not know if this one has some real value or
be implemented alreday. Any comment or feedback is welcome!
Back to top
 
Post new topic   Reply to topic    CASTalk.com Forum Index -> Storage System All times are GMT
Page 1 of 1

 
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum




VoIP Electronics Powered by phpBB