Home page
Telegram bot

Lecture 2: Entropy and Data Compression (I): Introduction to Compression, Inf.Theory and Entropy




Video quality The size Download

Information Lecture 2: Entropy and Data Compression (I): Introduction to Compression, Inf.Theory and Entropy


Title :  Lecture 2: Entropy and Data Compression (I): Introduction to Compression, Inf.Theory and Entropy
Lasting :   51.09
Date of publication :  
Views :   97 rb


Frames Lecture 2: Entropy and Data Compression (I): Introduction to Compression, Inf.Theory and Entropy





Description Lecture 2: Entropy and Data Compression (I): Introduction to Compression, Inf.Theory and Entropy



Comments Lecture 2: Entropy and Data Compression (I): Introduction to Compression, Inf.Theory and Entropy



@eddiehazel1259
clipping reduces as it goes on, information content regained, i think maybe you shouts when you are nervous more interstitial melodies, perhaps the beautiful entropy
Comment from : @eddiehazel1259


@frasio3930
thanks for uploading these excellent lectures (RIP David
Comment from : @frasio3930


@iirclife
Sigh totally lost back to the beginning of the video
Comment from : @iirclife


@giantbee9763
Rest in peace David :) Thanks for the lectures
Comment from : @giantbee9763


@LucasSilva-rf5mf
Sir D Mackay was an inspiration RIP
Comment from : @LucasSilva-rf5mf


@Crashof2008
At 46:00 of this excellent video, Professor MacKay agrees with the bbrilliant/b student question that maximizing entropy (or asking questions which maximize equiprobable outcomes) is bnot/b always the best strategy in these games brbrWhy not? Scratching my head in Silicon Valley! Matt
Comment from : @Crashof2008


@afarro
RIP
Comment from : @afarro


@hyperduality2838
Repetition (redundancy) is dual to variation -- musicbrCertainty is dual to uncertainty -- the Heisenberg certainty/uncertainty principlebrSyntropy (prediction) is dual to increasing entropy -- the 4th law of thermodynamicsbrRandomness (entropy) is dual to order (predictability) -- "Always two there are" -- YodabrTeleological physics (syntropy) is dual to non teleological physicsbrDuality: two sides of the same coin
Comment from : @hyperduality2838


@-gbogbo-
Fantastic course ! Does it exist in 720p by any chance ?
Comment from : @-gbogbo-


@prajwolgyawali6770
Revision: Upto 2:30brbr5:05 In standard communication system what we want to do is exploit redundancy that already exists in the real source and get rid of it, shrink the file (ie compress it first to make it idealize source) so we can put into channel coding method brbrThe Bent Coin 7:15brShannon's Claim: 11:00brEntropy: 19:30brThe Weighing Problem Solution: 21:08brThe Bent Coin Lottery: 47:15
Comment from : @prajwolgyawali6770


@isupeene
The question as stated is about minimizing the guaranteed number of weighings, not the expected number of weighings, so we really ought to be maximizing the minimum information we can get from each weighing, rather than the entropy
Comment from : @isupeene


@siaahmadi413
In case anybody is interested I wrote a demo for the weighing problem in matlab githubcom/siaahmadi/weighingproblem
Comment from : @siaahmadi413


@mariannarespond21
high-value talk, thank you for uploading
Comment from : @mariannarespond21


@itwipsy17
at 34:12, why is the probability 2/8 in even case of HHL,HHL ? and in case of GGG,LLL (LHHHH), why are the probability 0, 5/8, 3/8??
Comment from : @itwipsy17


@kuntoroan
Interesting lecture but I don't understand the second weighing entropy computation How can 4 good balls and 4 light balls result in balance weighing with probability 05?brBeside that, the odd ball is only one and either lighter or heavier How can heavy and light ball assumed appear at the same time?brbrAny help will be very appreciated Thank you very much
Comment from : @kuntoroan


@stephenwaite4737
I find this fascinating and was trying to work out the math How did he get 148 bits on the 5x5 example at 26:22? I tried averaging log base 2 of 5/12,2/12, and 5/12 divided by 3 but that is clearly wrong Would appreciate any help Thanks
Comment from : @stephenwaite4737


@abusesay2052
Excellent,Long live
Comment from : @abusesay2052


@Nahulanham
I sense a major conflict between Shannon's model and economic creativity theories of GIlder Reducing redundancy, noise reduction and lossless transmissions are contraindicative to Gilder's idea of creativity and growth Any responses on this?
Comment from : @Nahulanham


@hashemmohammed4420
Vielen Dank, Das hat mir sehr geholfen
Comment from : @hashemmohammed4420


@jackevans2386
Noisy channel audio should have been cleaned up first !  It's distorted in fact
Comment from : @jackevans2386


@2Cerealbox
Thank you so much for uploading these They're great
Comment from : @2Cerealbox



Related Lecture 2: Entropy and Data Compression (I): Introduction to Compression, Inf.Theory and Entropy videos

Entropy | Information Theory | Episode 2 Entropy | Information Theory | Episode 2
РѕС‚ : Simon Oz
Download Full Episodes | The Most Watched videos of all time
Project Schedule Compression Techniques - Key Concepts in Project Management from the PMBOK Project Schedule Compression Techniques - Key Concepts in Project Management from the PMBOK
РѕС‚ : David McLachlan
Download Full Episodes | The Most Watched videos of all time
100% Real Data Entry Jobs ?Part Time Data Entry Work | Data Entry Jobs Work From Home | Earn Money 100% Real Data Entry Jobs ?Part Time Data Entry Work | Data Entry Jobs Work From Home | Earn Money
РѕС‚ : Rahul Upmanyu
Download Full Episodes | The Most Watched videos of all time
Airtel 1 GB Data Loan kaise le | how to get 1 GB Data Loan from airtel | Data Loan apply | Airtel 1 GB Data Loan kaise le | how to get 1 GB Data Loan from airtel | Data Loan apply |
РѕС‚ : My Technical Abu
Download Full Episodes | The Most Watched videos of all time
2GB Data Free ||Airtel Free Data 2024 | Airte Free Data Code #shors​ #airtel​ #airtelfreedata​ 2GB Data Free ||Airtel Free Data 2024 | Airte Free Data Code #shors​ #airtel​ #airtelfreedata​
РѕС‚ : Technical Dream sk
Download Full Episodes | The Most Watched videos of all time
The top 3 cheat codes inf GTA 5 The top 3 cheat codes inf GTA 5
РѕС‚ : DeKing
Download Full Episodes | The Most Watched videos of all time
social welfare by money saving powerpoint templates ppt backgrounds for slides 0413 presentation inf social welfare by money saving powerpoint templates ppt backgrounds for slides 0413 presentation inf
РѕС‚ : Tom From SlideTeam
Download Full Episodes | The Most Watched videos of all time
Lecture 1: Introduction to Information Theory Lecture 1: Introduction to Information Theory
РѕС‚ : Jakob Foerster
Download Full Episodes | The Most Watched videos of all time
MIT DCAI Lecture 1: Data-Centric AI vs. Model-Centric AI MIT DCAI Lecture 1: Data-Centric AI vs. Model-Centric AI
РѕС‚ : Students for Open and Universal Learning
Download Full Episodes | The Most Watched videos of all time
Lecture 1: Introduction to Power and Politics in Today’s World Lecture 1: Introduction to Power and Politics in Today’s World
РѕС‚ : YaleCourses
Download Full Episodes | The Most Watched videos of all time


Local School For Students With Learning Disabilities To Open High School Building | 50 Pfennig Coins Of GERMANY Part 1 1949 | Distance Learning PhD Programmes At Manchester Metropolitan University | Very Old 1808 East India Company Trading Coin From Shipwreck | Canadian Coin And Currency Yonge St | Days Of The Week ChuChu TV Surprise Eggs Learning Videos For Kids | How I Made Over 100,000,000 COINS In Madden 24 As No Money Spent...... | Warren Buffett: How To Invest Tiny Sums Of Money | How To Get Play Money On Pokerstars | Part Time And Online Learning UK Degrees | 1976 Montreal Olympic 10 Dollar Silver Bike Coin 925 | Sims 3 Money Cheat Xbox 360 | The Importance Of Learning A Foreign Language Essay | VOA Learning English Education Report # 393 | Baby And Toddler Learning ABC’s, First Words, Vowel Sounds, Speech??? ♥️ #tittlekins #mstasha | 4 Websites That Accept Debit Or Credit Card Without OTP Verification (Generate Money) | Popular Ideas About Language Learning Revisited | Video On How To Make A Money Tree On Animal Crossing Wild World! | Rare British 2 New Pence 1971 Elizabeth II Coin || Rare Foreign Coins || Rare World Coins | Creating A Safe And Supportive Learning Environment | How To Book Appointment For Driving Licence|learning Licence Slot Booking Kaise Kare|DL Slot Book | BITCOIN ZNOWU SPADNIE PRZEZ TRUMPA? Gdzie Będę SKUPOWAŁ? *moja Złota Strefa* | 5 Best Amazon Shopping Tips And Tricks To Save Money In Tamil | Pawn Stars: Rare Gold Coin Sparks Intense Negotiation (Season 3) | Fifa 15 Coins Generator 2015 Ultimate Team | HOW TO SAVE MONEY SHOPPING ON AMAZON | The FASTEST Way To Start Making Money On YouTube | Lifelong Learning For Your Customers With NCFE | Tuga Kelompok 3 DATA SET "UCI Machine Learning Repository" | How To Transfer Money From Australia To Sri Lanka (2025) | Lil Boosie Ft Hurricane Chris Money Money Money (New 2009) | WWE Money In The Bank: CM Punk Vows To Defeat John Cena | No Money, No Job, No Car, No House | NEW $1000 Per Day AI Side Hustle! How To Make Money Online 2025 | How Do I Get My Money Back From Amazon