shannon capacity limit

Digital Signal Processing using computers.

shannon capacity limit

Postby elite » Mon Dec 26, 2005 5:15 pm

Base on shannon capacity limit,what are the possibility of transmittin
information when the signal is lower than the noise?

thks for any help that is being provided for the above question.
elite
 

Re: shannon capacity limit

Postby Steve Underwood » Mon Dec 26, 2005 5:15 pm

elite wrote:
Base on shannon capacity limit,what are the possibility of transmitting
information when the signal is lower than the noise?

thks for any help that is being provided for the above question.

Why not plug the numbers into the channel capacity equation, and see?

Steve
Steve Underwood
 

Re: shannon capacity limit

Postby IM » Tue Dec 27, 2005 9:15 am

Hello:

Spread Spectrum.
IM
 

Re: shannon capacity limit

Postby James (Sungjin) Kim » Tue Dec 27, 2005 9:15 am

Steve Underwood wrote:
elite wrote:

Base on shannon capacity limit,what are the possibility of transmitting
information when the signal is lower than the noise?

thks for any help that is being provided for the above question.


Why not plug the numbers into the channel capacity equation, and see?

Steve


In that case where the signal power is lower than the noise power,
shannon capacity is represented as

C = log2( 1 + SNR)

where SNR = P_s / P_n < 1. This means that up to SNR is 0, there is a
way to transmit the information of which the transmission rate is less
than C. To understand the shannon capacity formula, we must remind that
the frame size is infinitely large and the coding scheme is a random
coding. Note that if we use a better coding scheme, e.g., LDPC or turbo
coding, than the random coding which shannon used, we achive close to
shannon capacity with even shorter frame size.

- James Gold
James (Sungjin) Kim
 

Re: shannon capacity limit

Postby robert bristow-johnson » Wed Dec 28, 2005 9:15 am

elite wrote:
Base on shannon capacity limit,what are the possibility of transmitting
information when the signal is lower than the noise?

you know those beautiful photos of Jupiter, Saturn, Uranus, and Neptune
that Voyager 1 & 2 were sent from a 20 watt transmitter (with a pretty
good beam antenna) over billions of kilometers of distance (run the
inverse-square law on that one!) and both space and our atmosphere are
known to be pretty noisy. i think the S/N ratio was many dBs below 0.
yet we got them beautiful photos. (it might have taken days to receive
and decode the data.)

even if S/N << 1, as long as it's > 0, there is some channel capacity.
you might need a helluva lot of redundancy to encode the weak signal to
get through all that noise (and redundancy takes *time*), but you can
do it.

beside "Spread Spectrum" (as was mentioned), also look up "Reed-Soloman
Coding". (speeling not gauranteeded.)

thks for any help that is being provided for the above question.

FWIW.

r b-j
robert bristow-johnson
 

Re: shannon capacity limit

Postby Jerry Avins » Wed Dec 28, 2005 5:15 pm

robert bristow-johnson wrote:
... (speeling not gauranteeded.)

Shouldn't that be "spieling"?

Jerry
--
Engineering is the art of making what you want from things you can get.
¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯
Jerry Avins
 

Re: shannon capacity limit

Postby Randy Yates » Wed Dec 28, 2005 5:16 pm

"James (Sungjin) Kim" <jamessungjin.kim@gmail.com> writes:

Steve Underwood wrote:
elite wrote:

Base on shannon capacity limit,what are the possibility of transmitting
information when the signal is lower than the noise?

thks for any help that is being provided for the above question.
Why not plug the numbers into the channel capacity equation, and see?
Steve


In that case where the signal power is lower than the noise power,
shannon capacity is represented as

C = log2( 1 + SNR)

where SNR = P_s / P_n < 1. This means that up to SNR is 0, there is a
way to transmit the information of which the transmission rate is less
than C.

This is also known as the "channel coding theorem": "All rates below
capacity C are achievable."
--
% Randy Yates % "Maybe one day I'll feel her cold embrace,
%% Fuquay-Varina, NC % and kiss her interface,
%%% 919-577-9882 % til then, I'll leave her alone."
%%%% <yates@ieee.org> % 'Yours Truly, 2095', *Time*, ELO
http://home.earthlink.net/~yatescr
Randy Yates
 

Re: shannon capacity limit

Postby James G. » Wed Dec 28, 2005 5:16 pm

â”
James G.
 

Re: shannon capacity limit

Postby James G. » Wed Dec 28, 2005 5:16 pm

FWIW ??
James G.
 

Re: shannon capacity limit

Postby Randy Yates » Wed Dec 28, 2005 5:16 pm

"James G." <JamesSungjin.Kim@gmail.com> writes:

FWIW ??

For What It's Worth.
--
% Randy Yates % "I met someone who looks alot like you,
%% Fuquay-Varina, NC % she does the things you do,
%%% 919-577-9882 % but she is an IBM."
%%%% <yates@ieee.org> % 'Yours Truly, 2095', *Time*, ELO
http://home.earthlink.net/~yatescr
Randy Yates
 

Re: shannon capacity limit

Postby Jerry Avins » Wed Dec 28, 2005 11:29 pm

James G. wrote:
[quote]â”
Jerry Avins
 

Re: shannon capacity limit

Postby Vladimir Vassilevsky » Thu Dec 29, 2005 1:16 am

robert bristow-johnson wrote:


you know those beautiful photos of Jupiter, Saturn, Uranus, and Neptune
that Voyager 1 & 2 were sent from a 20 watt transmitter (with a pretty
good beam antenna) over billions of kilometers of distance (run the
inverse-square law on that one!) and both space and our atmosphere are
known to be pretty noisy. i think the S/N ratio was many dBs below 0.
yet we got them beautiful photos. (it might have taken days to receive
and decode the data.)


The Shannon formula deals with E/No ratio (energy per bit of useful
information divided by noise specral density), which is much more
informative parameter then SNR. For Voyager missions the E/No threshold
was somewhere around 3dB, i.e. much higher then the noise.


beside "Spread Spectrum" (as was mentioned), also look up "Reed-Soloman
Coding". (speeling not gauranteeded.)

Shannon formula relates to the useful information only. The redundancy
of the SS and/or RS is a different story.

Vladimir Vassilevsky

DSP and Mixed Signal Design Consultant

http://www.abvolt.com
Vladimir Vassilevsky
 


Return to DSP

Who is online

Users browsing this forum: No registered users and 0 guests

cron