Thursday, January 25, 2007

Getting a huge list of Universities URLs

I was asked by my doctor during the semester to create a list of universities URLs and make it as large as possible, and since I have finished my exams, I started to create it by downloading a number of lists of the world universities from the Internet (one of them contains 113 pages from http://univ.cc/ website).

I developed a program to read these files and extract the URL from the anchor tag, and finally I ended up with a list of 7080 universities URLs, which was my second list after getting a list of 128708 but with redundant data.

1 comment:

Anonymous said...

People should read this.