Department of Computer Science & Engineering

University of Ioannina

Information Theory

Course Feature
Class Description

Course_ID: MYE015

Weekly Hours: 5

Semester: >=6

ECTS Credits: 5

Course Homepage:http://www.cs.uoi.gr/~cnikou/Information_Theory.html

Description: Information, Entropy, Joint Entropy, Conditional Entropy, Mutual Information, Extensions of Information Sources, Information Sources with Memory, Memoryless Information Sources, Markov chains, Continuous Information Source. Information Channel, Channel Capacity (Maximum Mutual Information), Muroga Method. Coding in Noiseless environment, the Kraft inequality, Shannon’s Noiseless Coding Theorem, Shannon Coding, Shannon-Fano Coding, Huffmann Code, Shannon’s Fundamental Coding Theorem, Error Correcting Codes, Hamming Code. Algebraic Coding, Groups, Fields, Rings, Vector Spaces, modulo-ρ and modulo-k(x) algebra, Error Correcting Codes, Group Codes (Hamming, Hadamard, Golay), Cyclic Codes (Hamming, Golay, BCH), Convolutional Codes.

  • Christophoros Nikou

    • Ph.D. in Image Processing and Computer Vision, Universite Louis Pasteur - Strasbourg I, France 1999
    • DEA in Photonics and Image Processing, Universite Louis Pasteur - Strasbourg I, France 1995
    • Diploma, Electrical Engineering Department, Aristotle University of Thessaloniki, Greece, 1994