Intro to Information Theory | Digital Communication | Information Technology

Share this & earn $10
Up and Atom
Published at : 06 Dec 2020
85623 views
4046
62

Shannon Entropy in Information theory. Compression and digital communication in systems and technology. The Entropy of English.

The video we did over on Mark's channel! https://youtu.be/VF5MGLRlXVw
Subscribe to Mark's channel Alliterative! https://www.youtube.com/user/Alliterative

Hi! I'm Jade. Subscribe to Up and Atom for new physics, math and computer science videos every second week!

This video was co-written by my super smart hubby Simon Mackenzie.

*SUBSCRIBE TO UP AND ATOM* https://www.youtube.com/c/upandatom

*Follow me* @upndatom

INSTAGRAM: https://www.instagram.com/upndatom/
TWITTER: https://twitter.com/upndatom?lang=en

A big thank you to my AMAZING PATRONS!
Alan McNea, Daniel Tan-Holmes, Simon Mackenzie, Yoseph, Andrew Pann, Dave, Anne Tan, Todd Loreman, David, Susan Jones, Stephen Veitch, Dave Mayer, Renato Pereira, Simon Dargaville, Dean Madden, Noah McCann, Robert Frieske, Magesh.

If you'd like to consider supporting Up and Atom, head over to my Patreon page :)
https://www.patreon.com/upandatom

For a one time donation, head over to my PayPal :)
https://www.paypal.me/upandatomshows

Other videos you might like:
What is a Singularity, Exactly? https://youtu.be/NLQNBfI97Ck
When to Think Less (According to Math) https://youtu.be/sivWzd_AecU
When to Quit (According to Math) https://youtu.be/tVRGadNoHC0

Here's more stuff to read if you're interested :
https://www.princeton.edu/~wbialek/rome/refs/shannon_51.pdf
http://people.seas.harvard.edu/~jones/cscie129/papers/stanford_info_paper/entropy_of_english_9.htm
Shannon entropyinformation technologyinformation theory

5 New Ways to Promote YOUR Music *best way*

5 New Ways to Promote YOUR Music *best way*

You Need to Make This, but [How]?

You Need to Make This, but [How]?

Florence + The Machine - Girl With One Eye (Live on Letterman)

Florence + The Machine - Girl With One Eye (Live on Letterman)

Virus, Worms and Trojan Horses Brief Introduction and Difference between their Functionality

Virus, Worms and Trojan Horses Brief Introduction and Difference between their Functionality

Countries of the WORLD at their GREATEST extent.

Countries of the WORLD at their GREATEST extent.

Apple made the right call.

Apple made the right call.

RIOT BLOCKCHAIN STOCK (RIOT) BREAKOUT | $RIOT Price Prediction + Technical Analysis

RIOT BLOCKCHAIN STOCK (RIOT) BREAKOUT | $RIOT Price Prediction + Technical Analysis

How to have an attention grabbing cv on LinkedIn

How to have an attention grabbing cv on LinkedIn

Automobiles of the 40's and 50's

Automobiles of the 40's and 50's

Peking duck

Peking duck

LIVE: Trump Supporters lining up ahead of tonight’s Comeback Rally in Florida...

LIVE: Trump Supporters lining up ahead of tonight’s Comeback Rally in Florida...

The "Reasonably" Priced Dado Laser Welder For Jewelry

The "Reasonably" Priced Dado Laser Welder For Jewelry

Art with no money

Art with no money

Lil Nas X - HOLIDAY (10 Hours)

Lil Nas X - HOLIDAY (10 Hours)

The Making of the NFL 100 Super Bowl Commercial

The Making of the NFL 100 Super Bowl Commercial

[WEEKLY] "BLOODBATH" 100% (EXTREME DEMON) by Riot | Geometry Dash

[WEEKLY] "BLOODBATH" 100% (EXTREME DEMON) by Riot | Geometry Dash

TWICE “MORE & MORE” Dance Practice Video

TWICE “MORE & MORE” Dance Practice Video

Adding an additional Domain Controller to an existing domain in Windows Server 2012 R2

Adding an additional Domain Controller to an existing domain in Windows Server 2012 R2

Find Duplicate & Highlight Entire Row (Just In 30 Seconds)

Find Duplicate & Highlight Entire Row (Just In 30 Seconds)

chickpet wholesale readymade blouse shop| starting from 65rs| Bangalore shopping

chickpet wholesale readymade blouse shop| starting from 65rs| Bangalore shopping

Trump abruptly ends interview on wiretapping

Trump abruptly ends interview on wiretapping

Steven Seagal: Certified Tough Guy - JonTron

Steven Seagal: Certified Tough Guy - JonTron

Jakob Ogawa - You Might Be Sleeping [w. Clairo]

Jakob Ogawa - You Might Be Sleeping [w. Clairo]

Heart Attack Man - Undoubtedly

Heart Attack Man - Undoubtedly

INTEGRANTES DEL CLAN RE4LG4LIFE COMPITEN POR UNA BOLSA DE 500$ DÓLARES / RG4 ALL STARS

INTEGRANTES DEL CLAN RE4LG4LIFE COMPITEN POR UNA BOLSA DE 500$ DÓLARES / RG4 ALL STARS

Make an Allowance  Part 1

Make an Allowance Part 1

Johnny Gill Performs "Outstanding" in Tribute to Charlie Wilson at NMAAM

Johnny Gill Performs "Outstanding" in Tribute to Charlie Wilson at NMAAM

LAST TO GO TO THE BATHROOM WINS!! CHALLENGE w/The Shumway Show

LAST TO GO TO THE BATHROOM WINS!! CHALLENGE w/The Shumway Show

I Want a New Duck

I Want a New Duck

ΠΑΑΥΡΑ or AMKA

ΠΑΑΥΡΑ or AMKA

МИДОВАЯ ЭНЧА🔥 НИКТО ТАКОГО не ОЖИДАЛ..

МИДОВАЯ ЭНЧА🔥 НИКТО ТАКОГО не ОЖИДАЛ..

5 Seconds of Summer, Charlie Puth - Easier – Remix (Audio)

5 Seconds of Summer, Charlie Puth - Easier – Remix (Audio)

Reason Micro Tutorial - Dr. Octo Rex

Reason Micro Tutorial - Dr. Octo Rex

Introduction to Symbolism

Introduction to Symbolism

TOPIC - FIND YOU feat. Jake Reese (Official Video) 4K

TOPIC - FIND YOU feat. Jake Reese (Official Video) 4K

Халид ибн Аль-Валид,
Битва при Муте 200 тысяч римлян против 3 тыс мусульман

Халид ибн Аль-Валид, Битва при Муте 200 тысяч римлян против 3 тыс мусульман

Joe Biden assembles “pandemic taskforce” ahead of taking office  - BBC News

Joe Biden assembles “pandemic taskforce” ahead of taking office - BBC News

58 and other Confusing Numbers - Numberphile

58 and other Confusing Numbers - Numberphile

Managing Healthcare Capacity to Ensure every Singaporean Receives Necessary Care and Treatment

Managing Healthcare Capacity to Ensure every Singaporean Receives Necessary Care and Treatment

Basic electronics Guide to components in Hindi

Basic electronics Guide to components in Hindi

How to solve the LED Headlights Flickering issue ? Broview M5 Canbus 9007 can solve it

How to solve the LED Headlights Flickering issue ? Broview M5 Canbus 9007 can solve it

"15 to 20"  The Phenomenal Handclap Band Official Video

"15 to 20" The Phenomenal Handclap Band Official Video

[第十四回 博麗神社例大祭] (SNUG SPACE) FORTUNE

[第十四回 博麗神社例大祭] (SNUG SPACE) FORTUNE

Ringa Ringa Roses | Ring Around the Rosie -3D Kid's Songs & Nursery Rhymes for children

Ringa Ringa Roses | Ring Around the Rosie -3D Kid's Songs & Nursery Rhymes for children

Paper Dolls Dress Up 🔴 Costumes Sadako & Rapunzel Dresses Handmade 🔴 Barbie Story & Crafts

Paper Dolls Dress Up 🔴 Costumes Sadako & Rapunzel Dresses Handmade 🔴 Barbie Story & Crafts

Asaf Avidan - A Gun And  A Choice

Asaf Avidan - A Gun And A Choice

Wished Theatrical Trailer 反转人生终极预告片

Wished Theatrical Trailer 反转人生终极预告片

A Certain Ratio - Always In Love (Official Visual)

A Certain Ratio - Always In Love (Official Visual)

-The Phobia Project- Extended Demo longplay -no commentary-

-The Phobia Project- Extended Demo longplay -no commentary-