Information Networks Datasets and Code

Home Announcements Homework Reading List References Datasets and Code Interesting Links

Datasets Autonomous Systems Internet graphs (undirected) The AS graphs are also stored locally in the following format (node id, node id 1) where ids start from 1 (suitable for input to matlab) AS1, AS2, AS3, AS4, AS5, AS6, AS7, AS8 Collections of web pages related to queries used for testing Link Analysis Ranking algorithms Wikipedia graphs (italian, french, czech) Format: (from to) (directed) Co-authorships graph Format: author id, author id, 1 (ids start from 1 -- suitable for input to matlab) (undirected) US Power Grid Format: First column = "from vertex"; Subsequent columns = neighbors; "#" = end of line marker (undirected) C.Elegans neural network Format: First column = "from" vertex; Second = "to" vertex; Third column = weight of connection (# links) (directed) Protein-Protein Interaction databases (some of them offer data freely (e.g. MINT, DIP), others not. Take a look at the survey in the reading list, where it is mentioned where you can find data available online) Datasets from Univesity of Notre Dame Code This is code for fitting a line to a set of points. The points are read from a file named datafile where each line of the file contains a pair of values x,y separated by a line. The fitline.m code An example of a datafile The following is code in Perl that I had written for fetching pages. It is relatively easy to create a small crawler using Perl. If you need additional help/code, you can contact me. fetch_page.pl: perl code for fetching a page extract_links.pl: perl code for extracting links You can use code that is available on-line, but if you do you should mention it in your project report. Also writing your own code will be counted towards the project grade. Here are some places where I found available code (they may also contain data) Analytic Technologies MATURIN project (includes also code for Windows) The METIS graph clustering project