skip to main content
Department of Computer Science University of Colorado Boulder
cu: home | engineering | mycuinfo | about | cu a-z | search cu | contact cu cs: about | calendar | directory | catalog | schedules | mobile | contact cs
home · events · bactac · 2008-2009 · 

BACTAC - Jiang

ECOT 831

Effective Crawler for Online Social Networks
Yifei Jiang
Graduate Student

Online social communities are among the most popular sites on the Internet, which provides an opportunity to study these online social websites. In this project we study the online social community crawling problem, which is a fundamental step in many research areas of online social networks, such as studying the characteristics of online social networks, search engines and data mining. Compared to a regular website, there are some challenges for crawling online social networks.

  1. Links structure between pages in online social websites is much more complicated than other websites, which causes a large number of duplicate pages.

  2. A lot of duplicate content is listed in online social networks. For example, users could be listed both by friend list and community numbers.

  3. Some pages in online social websites do not include any useful information, such as the user register page and comments inputting pages which only provide input forms for users.

In our project, we try to propose and implement an online social network crawler to avoid crawling above duplicate and uninformative web pages to improve the crawling efficiency.

BACTAC, the Beverage And Chips Tuesday Afternoon Colloquium, is a weekly forum run by graduate students. The goal is provide an informal setting in which anyone can (basically) present anything. In the past, we have had practice talks for conferences and job interviews, research reports, juggle lessons (!), student representative reports, internship discussions, an introduction to ergonomics, and "pay attention to this when you are going to look for job" discussions.

BACTAC is meant to be an informal and social event to promote the interaction among graduate students. BACTAC is typically held every Tuesday, at 3:30pm, in room ECOT 831. Free munchies and drinks are provided.

Please email Caleb Phillips for more information or if you want to be a speaker.

See also:
Department of Computer Science
College of Engineering and Applied Science
University of Colorado Boulder
Boulder, CO 80309-0430 USA
Send email to

Engineering Center Office Tower
ECOT 717
FAX +1-303-492-2844
XHTML 1.0/CSS2 ©2012 Regents of the University of Colorado
Privacy · Legal · Trademarks
May 5, 2012 (13:44)