CSE012/CS059 – Data Mining

Fall 2021

Lecture Slides

For the slides of this course we will use slides and material from other courses and books. We thank in advance: Tan, Steinbach and Kumar, Anand Rajaraman Jeff Ullman, and Jure Leskovec, Evimaria Terzi, Aris Anagnostopoulos for the material of their slides that we have used in this course.

Introduction: Logistics (in Greek) (pptx, pdf)

Lecture 1: Introduction to Data Mining (pptx, pdf)

Chapters 1,2 from the book “Introduction to Data Mining” by Tan Steinbach Kumar.
Article: Data Scientist: The Sexiest Job of the 21st Century.

Lecture 2: What is data? The data mining pipeline. Preprocessing and postprocessing. Sampling and normalization. (pptx, pdf)

Chapter 2 from the book “Introduction to Data Mining” by Tan Steinbach Kumar.
Chapter 1 from the book Mining Massive Datasets by Anand Rajaraman and Jeff Ullman, Jure Leskovec.

Tutorial 1: Introduction to discrete probabilities. (pptx, pdf)

Thanks to Aris Anagnostopoulos for the slides.
Part I from the book All of Statistics by Larry A. Wasserman

Lecture 3: Data exploration and statistical analysis (pptx, pdf)

Chapter 1 from the book Mining Massive Datasets by Anand Rajaraman and Jeff Ullman, Jure Leskovec.
Chapters 7-8 (confidence interval, standard error), 11 (hypothesis testing), 16 (independence and correlation tests) from the book All of Statistics byLarry A. Wasserman (the chapter numbers are for the pdf, in the actual book the chapter numbers are -1 of the ones above).
Error bars in experimental biology.

Tutorial 2: Introduction to notebooks. Python reminders.

Slides: pptx, pdf
Notebook with Python Reminders (ipynb, html, html slides, pdf)

Lecture 4: Similarity and Distance. Recommendation Systems (pptx, pdf)

Chapter 2 from the book “Introduction to Data Mining” by Tan Steinbach Kumar.
Chapters 3,9 from the book Mining Massive Datasets by Anand Rajaraman and Jeff Ullman, Jure Leskovec.
Article: The long tail.

Τutorial 3: Introduction to the Pandas library

Notebook for Pandas (ipynb, html, html slides, pdf)
The files for the notebooks
Notes from the class of Evimaria Terzi and Mark Crovella

Τutorial 4: Libraries for statistical analysis and plotting

Notebook for Plotting, Statistical Analysis (ipynb, html, html slides, pdf)
The file example-functions.csv
Notes from the class of Evimaria Terzi and Mark Crovella

Lecture 5: Dimensionality Reduction. Singular Value Decomposition (SVD). Principal Component Analysis (PCA). Model-based collaborative filtering (pptx, pdf)

Chapter 11 from the book Mining Massive Datasets by Anand Rajaraman and Jeff Ullman, Jure Leskovec.
Appendices A,B from the book “Introduction to Data Mining” by Tan Steinbach Kumar.
A tutorial on Principal Component Analysis, Jonathon Shlens

Tutorial 5: Introduction to the Numpy and SciPy libraries for matrix manipulation (ipynb, html, html slides, pdf).

Lecture 6: Clustering. The k-means algorithm. Hierarchical Clustering. The DBSCAN algorithm. Clustering Evaluation. (pptx, pdf)

Chapters 8,9 from the book “Introduction to Data Mining” by Tan Steinbach Kumar.
Chapter 7 from the book Mining Massive Datasets by Anand Rajaraman and Jeff Ullman, Jure Leskovec.

Tutorial 6: Libraries for data preprocessing (ipynb, html, html slides, pdf)

Lecture 7: Mixture Models. The EM Algorithm. (pptx, pdf)

Notes on the EM algorithm by Aris Anagnostopoulos, University of Rome La Sapienza

Tutorial 7: Introduction to the SciKit-Learn (sklearn) library for clustering (ipynb, html, html slides, pdf)

Lecture 8: Introduction to Supervised Learning. Linear Regression. Classification. Decision Trees - Expressiveness. Nearest Neighbor Classification, Support Vector Machines, Logistic Regression, (Naive Bayes Classification) (pptx, pdf)

Chapter 14 (in the pdf) from the book All of Statistics byLarry A. Wasserman
Chapters 4,5 from the book “Introduction to Data Mining” by Tan Steinbach Kumar.
Chapter 12 from the book Mining Massive Datasets by Anand Rajaraman and Jeff Ullman, Jure Leskovec.
Chapter 13 from the book "Introduction to Information Retrieval" by C. Manning, P. Raghavan, H. Schutze

Lecture 9: Neural Networks. Word Embeddings. Evaluation. The Supervised Learning pipeline. (pptx, pdf)

Chapters 4,5 from the book “Introduction to Data Mining” by Tan Steinbach Kumar.
Chapter 12 from the book Mining Massive Datasets by Anand Rajaraman and Jeff Ullman, Jure Leskovec.
Chris Manning, Natural Language Processing with Deep Learning, Lecture Notes, Part I

Tutorial 8: Introduction to the scikit-learn library and applications to classification. The gensim library and word embeddings. (Notebook: ipynb, html, html slides).

Lecture 10: Link Analysis Ranking Web Ranking. PageRank, Random Walks, HITS. Absorbing Random Walks. (pptx, pdf)

Chapter 21 from the book "Introduction to Information Retrieval" by C. Manning, P. Raghavan, H. Schutze
Chapter 14 from the book "Networks Crowds and Markets" of D. Easley and J. Kleinberg
P. G. Doyle and J. L. Snell. Absorbing Random Walks and Electrical Networks.
Grindstead and Snell's Introduction to Probability (Chapter 11)

Tutorial 9: Introduction to the library NetworkX (Notebook: ipynb, html, html slides, pdf).

Το graph_edges.txt αρχείο
Το graph-example.txt αρχείο
Το karate.gml αρχείο