?? Work at Pickup Points � Flexible schedule

The Most Important (and Surprising) Result from Information Theory

Mutual Information 95 views

Download Video

Comments

woah that’s nuts
Comment from : @ericc6820

Your channel is excellent Extremely instructive and the videos are clearly thought out really well
Comment from : @joaopedromarrey5477

My instinct was that we should be able to do much better than what you initially suggested by using something like a checksum for credit cards The problem is that just tells you the message is wrong, not how to retrieve the correct one
Comment from : @Cowtymsmiesznego

I assume the flip probability is randomand not fixed with Boolean switches brthis creates the error, chancebryour scrambling the message ( slightly ) , not hiding itbrcreates a receiver errorbrcause the flip is not a fixed switchbrbryou would need to use like a roller, on an enigma, and flip with a algorithmbrand create "fake" noise
Comment from : @findstrs-hi-c_w

What happened DJ? You quit on us? No new vids in four months! 😐
Comment from : @Daniel-Six

You have all the exact same mannerisms as the channel “Whaddo You Meme” 😂 Love the video!
Comment from : @marcusaragnos1041

Shannon invented relu!
Comment from : @alleycatsphinx

Just stumbled upon your channel, you’re amazing dude
Comment from : @losthalo428

Same reason why it’s possible to encode frequencies up to half of the sample rate He was a brilliant guy
Comment from : @davecool42

Great but can you fix the " that has gad an "?
Comment from : @grumpyoldman1257

Thanks!
Comment from : @iamr0b0tx

4:43 - But, this is the crux of the problem!
Comment from : @bazoo513

To quote my PhD supervisor, Prof James L Massey: "Do Communication Engineers Need Information Theory? - Not unless they want to understand what they are doing and to be at the forefront of future advances in communications!"
Comment from : @HufiVideo

Seems like it's because 05 is actually the highest error rate, if you're using flips as errors At 10 you're just reversing the message
Comment from : @kdhlkjhdlk

I dimly remember Huffman code Is that an example of the coding methods mentioned in this video? If yes, it would have been helpful to mention it
Comment from : @jamesraymond1158

Excellent So many speakers throw graphs out without properly explaining the axes Not here!
Comment from : @jamesraymond1158

I vaguely remember (from studies at college) something about using XOR to detect data errors
Comment from : @JesseGilbride

Google’s ads have made YouTube virtually unwatchable The advertisers who have signed up for this subterfuge are totally despicable
Comment from : @wertherquartett

I heard it You must have had a noisy channel Try again, and good luck
Comment from : @timothyallen6411

Can you please do a video on Reed Solomon encoding?
Comment from : @karldewet5393

ב''ה, 🪑
Comment from : @josephkanowitz6875

Great video! Btw your mic is picking up occasional plosives from your voice at very low frequencies and these are booming quite loud on a decent sound system with a subwoofer
Comment from : @meowsqueak

Sorry but i learned nothing from this video Waste of time
Comment from : @garcipat

what is your degree/scientific background?
Comment from : @tokajileo5928

Can you please suggest me best books for learning binary or digital systems in general? The books I have don't do a good job at motivating the concepts and explaining them in a "rediscoverable" manner
Comment from : @pizzarickk333

Love your videos!
Comment from : @LeoDaLionEdits

This isn't a result, it's just a lecture
Comment from : @khatharrmalkavian3306

I was about to say in the beginning “but the noise floor…”
Comment from : @Blueyzachary

Wow This video did not feel like 9 minutes long Amazing work
Comment from : @mattshnoop

Combination of mnim graphics and real life footage looks unusual for me
Comment from : @Avokadik13

In italian accent 🤌"Galois o' here buddy"
Comment from : @supercompooper

Honestly, I was expecting a more exponential-looking curve Is this a simplification? Isn't there any more effective error correction codes than the one used in the paper? I understand that it's not about the exact coding techniques, still can't wrap my head around on how they managed to neglect it The paper should make it clear, i guess
Comment from : @ЯСуперСтар

Cool video! At the right time too as I'm working on MDS now
Comment from : @sanchopanza9907

I didn't understand the "trick" Could anyone explain to me?
Comment from : @OhInMyHouse

This is so cool!
Comment from : @General12th

thank you! love from india
Comment from : @pappu10714

The quality of these videos is getting better and better Keep up this great work!
Comment from : @nikoskonstantinou3681

Nice video! For readers who are interested in machine learning, there is a nice (but distant) analogue of this for binary classification Suppose you are asked to build an AI that classifies whether an image is that of a cat or a dog What is the best error rate that you can get? Turns out it is independent of the size of the dataset!
Comment from : @MuniSreenivasPydi

Great Video! :)
Comment from : @actualBIAS

Great channel, I like to watch your videos after work but always find them a bit too quiet Maybe it's something with my hearing
Comment from : @jakubbelicki5755

i expected you to explain how the encoding works 😢
Comment from : @tommasobanfi8133

Great video! What's your background, by the way? Seems like you've maybe done a PhD in this kind of thing?
Comment from : @marcevanstein

channel capacity reaches its minimum 0 when f is 05 and maximum 1 when f tends to 0 Also it would be interesting to see whether the line between achievable and non achievable is linear after channel capacity
Comment from : @lqlaliut897