TWiki> CS450fall11 Web>Homework10 (2011-12-02, Main.jakob)EditAttach

Homework 10 - crawling the web (12 points!)

In our last homework, we return to the application layer. You will write a simple web-crawling application, which may be used to inventory a website, and to check the validity of the various links in said site.

Given the following command on the command-line:

./hw10 http://www.thesite.com/thepath summary visited checked broken

your program will do the following:

  • for each "a href" link that leads to a document with the same path prefix, follow the link and repeat this process for that document.
  • for each "a href" and "img src" URL, visit the URL. If the URL returns an error code (400 or 500 range), report this error
  • also report the following statistics:
    • documents visited
    • links checked (including visited documents)
    • broken links found
take care to make your program work on relative as well as absolute links, and to properly ignore any non-http links. The following is an example output. Try to replicate this output as closely as possible with your program:

$./hw10 http://www.cs.uic.edu/~llyons summary visited checked broken

jakob@ubuntu:~/cs450/main/solutions/hw10$ cat summary
Visited_pages: 12
Checked_URLs: 80
Broken_URLs: 4

jakob@ubuntu:~/cs450/main/solutions/hw10$ cat visited
http://www.cs.uic.edu/~llyons/
http://www.cs.uic.edu/~llyons/courses.html
http://www.cs.uic.edu/~llyons/index.html
http://www.cs.uic.edu/~llyons/not_available.html
http://www.cs.uic.edu/~llyons/papers.html
http://www.cs.uic.edu/~llyons/posters.html
http://www.cs.uic.edu/~llyons/projects_clizen.html
http://www.cs.uic.edu/~llyons/projects_cocensus.html
http://www.cs.uic.edu/~llyons/projects_ecocollage.html
http://www.cs.uic.edu/~llyons/projects.html
http://www.cs.uic.edu/~llyons/research.html
http://www.cs.uic.edu/~llyons/vita.html

jakob@ubuntu:~/cs450/main/solutions/hw10$ cat checked
http://dl.acm.org/citation.cfm?id=1978942.1979075
http://dl.acm.org/citation.cfm?id=1979742.1979777
http://grad.lsri.uic.edu/
http://grad.lsri.uic.edu/courses/index.asp
http://ltg.evl.uic.edu/clzen/index.html
http://pewresearch.org/pubs/1386/cap-and-trade-global-warming-opinion
http://professionals.collegeboard.com/profdownload/cbscs-science-standards-2009.pdf
http://tigger.uic.edu/~joshuar/
http://www1.cs.uic.edu/www/courses3.php?audience=public&course=ALL&label=Courses
http://www.apa.org/science/about/publications/climate-change.pdf
http://www.brookfieldzoo.org/czs/about-czs/leadership
http://www.brookfieldzoo.org/CZS/home.aspx
http://www.cs.uic.edu/
http://www.cs.uic.edu/~i422
http://www.cs.uic.edu/~i422/
http://www.cs.uic.edu/~llyons
http://www.cs.uic.edu/~llyons/
http://www.cs.uic.edu/~llyons/acrobat.png
http://www.cs.uic.edu/~llyons/bounce_sm.png
http://www.cs.uic.edu/~llyons/catalog_array.png
http://www.cs.uic.edu/~llyons/clizen_illus.jpg
http://www.cs.uic.edu/~llyons/cocensus_photo.jpg
http://www.cs.uic.edu/~llyons/courses.html
http://www.cs.uic.edu/~llyons/index.html
http://www.cs.uic.edu/~llyons/kids2.jpg
http://www.cs.uic.edu/~llyons/Lyons_CV.pdf
http://www.cs.uic.edu/~llyons/not_available.html
http://www.cs.uic.edu/~llyons/papers/chi_06_wip.pdf
http://www.cs.uic.edu/~llyons/papers/chi_07_dc.pdf
http://www.cs.uic.edu/~llyons/papers/cscl_09.pdf
http://www.cs.uic.edu/~llyons/papers.html
http://www.cs.uic.edu/~llyons/papers/icls_06_paper.pdf
http://www.cs.uic.edu/~llyons/papers/icls_10_ISE.pdf
http://www.cs.uic.edu/~llyons/papers/icls_10_UP.pdf
http://www.cs.uic.edu/~llyons/papers/idc_05_demo.pdf
http://www.cs.uic.edu/~llyons/papers/idc_05_poster.pdf
http://www.cs.uic.edu/~llyons/papers/paper_not_avail_thumb.jpg
http://www.cs.uic.edu/~llyons/papers/paper_thumb.jpg
http://www.cs.uic.edu/~llyons/papers/ubicomp_10_CoC.pdf
http://www.cs.uic.edu/~llyons/papers/ubicomp_10_PtP.pdf
http://www.cs.uic.edu/~llyons/papers/wmute_10.pdf
http://www.cs.uic.edu/~llyons/PolarBearWindow.jpg
http://www.cs.uic.edu/~llyons/posters/ASTC_07_poster.pdf
http://www.cs.uic.edu/~llyons/posters/astc_07_thumb.jpg
http://www.cs.uic.edu/~llyons/posters/CHI_06_poster.pdf
http://www.cs.uic.edu/~llyons/posters/chi_06_thumb.jpg
http://www.cs.uic.edu/~llyons/posters/CHI_07_poster.pdf
http://www.cs.uic.edu/~llyons/posters/chi_07_thumb.jpg
http://www.cs.uic.edu/~llyons/posters/CHI_11_poster.pdf
http://www.cs.uic.edu/~llyons/posters/chi_11_thumb.jpg
http://www.cs.uic.edu/~llyons/posters.html
http://www.cs.uic.edu/~llyons/posters/ICLS_10_ISE_poster.pdf
http://www.cs.uic.edu/~llyons/posters/ICLS_10_ISE_thumb.jpg
http://www.cs.uic.edu/~llyons/posters/ICLS_SSS_poster.pdf
http://www.cs.uic.edu/~llyons/posters/ICLS_SSS_poster_thumb.jpg
http://www.cs.uic.edu/~llyons/posters/SJ_10_EnvEd_poster.pdf
http://www.cs.uic.edu/~llyons/posters/SJ_10_EnvEd_thumb.jpg
http://www.cs.uic.edu/~llyons/posters/SJ_10_Stakeholders_poster.pdf
http://www.cs.uic.edu/~llyons/posters/SJ_10_Stakeholders_thumb.jpg
http://www.cs.uic.edu/~llyons/posters/UBICOMP_10_CoC_poster.pdf
http://www.cs.uic.edu/~llyons/posters/UBICOMP_10_CoC_thumb.jpg
http://www.cs.uic.edu/~llyons/posters/UBICOMP_10_PtP_poster.pdf
http://www.cs.uic.edu/~llyons/posters/UBICOMP_10_PtP_thumb.jpg
http://www.cs.uic.edu/~llyons/posters/WMUTE_10_poster.pdf
http://www.cs.uic.edu/~llyons/posters/WMUTE_10_thumb.jpg
http://www.cs.uic.edu/~llyons/projects_clizen.html
http://www.cs.uic.edu/~llyons/projects_cocensus.html
http://www.cs.uic.edu/~llyons/projects_ecocollage.html
http://www.cs.uic.edu/~llyons/projects.html
http://www.cs.uic.edu/~llyons/PtP.png
http://www.cs.uic.edu/~llyons/research.html
http://www.cs.uic.edu/~llyons/skills.html
http://www.cs.uic.edu/~llyons/train_llyons.jpg
http://www.cs.uic.edu/~llyons/vita.html
http://www.evl.uic.edu/aej/
http://www.lcoastpress.com/journal_issue.php?id=162
http://www.uic.edu/cuppa/upp/faculty/hoch.html
http://www.uic.edu/cuppa/upp/faculty/zellner.html
http://www.uic.edu/depts/bios/faculty/minor/minor.shtml
http://www.uic.edu/jaddams/hull/hull_house.html

jakob@ubuntu:~/cs450/main/solutions/hw10$ cat broken
http://www.cs.uic.edu/~llyons/papers/wmute_10.pdf from http://www.cs.uic.edu/~llyons/papers.html
http://ltg.evl.uic.edu/clzen/index.html from http://www.cs.uic.edu/~llyons/projects.html
http://www.cs.uic.edu/~llyons/skills.html from http://www.cs.uic.edu/~llyons/not_available.html
http://www.cs.uic.edu/~llyons/Lyons_CV.pdf from http://www.cs.uic.edu/~llyons/vita.html

./hw10 http://www.cs.uic.edu/~dasgupta/ summary.tex visited.tex checked.tex broken.tex

jakob@ubuntu:~/cs450/main/solutions/hw10$ cat summary
Visited_pages: 27
Checked_URLs: 473
Broken_URLs: 46

jakob@ubuntu:~/cs450/main/solutions/hw10$ cat visited
http://www.cs.uic.edu/~dasgupta/
http://www.cs.uic.edu/~dasgupta/brief-bio.html
http://www.cs.uic.edu/~dasgupta/contact.html
http://www.cs.uic.edu/~dasgupta/grad-support.html
http://www.cs.uic.edu/~dasgupta/network-data/
http://www.cs.uic.edu/~dasgupta/network-synthesis/
http://www.cs.uic.edu/~dasgupta/network-synthesis/help.html
http://www.cs.uic.edu/~dasgupta/pc.html
http://www.cs.uic.edu/~dasgupta/professional/algo-lab.html
http://www.cs.uic.edu/~dasgupta/professional/prof.html
http://www.cs.uic.edu/~dasgupta/professional/recent-projects.html
http://www.cs.uic.edu/~dasgupta/professional/software.html
http://www.cs.uic.edu/~dasgupta/resume/publ/publ.html
http://www.cs.uic.edu/~dasgupta/resume/publ/top10-jal-2003.html
http://www.cs.uic.edu/~dasgupta/resume/resume/grants.html
http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://www.cs.uic.edu/~dasgupta/slides.html
http://www.cs.uic.edu/~dasgupta/support.html
http://www.cs.uic.edu/~dasgupta/theorypage/theory-event-cs.html
http://www.cs.uic.edu/~dasgupta/theorypage/theory-group.html
http://www.cs.uic.edu/~dasgupta/theorypage/title-abs-borodin.html
http://www.cs.uic.edu/~dasgupta/theorypage/title-abs-jason.html
http://www.cs.uic.edu/~dasgupta/theorypage/title-abs-jinyicai.html
http://www.cs.uic.edu/~dasgupta/theorypage/title-abs-joan.html
http://www.cs.uic.edu/~dasgupta/theorypage/title-abs-ketan.html
http://www.cs.uic.edu/~dasgupta/theorypage/title-abs-schapira.html
http://www.cs.uic.edu/~dasgupta/undergrad-support.html
jakob@ubuntu:~/cs450/main/solutions/hw10$ cat checked
http://150.135.155.192/icnsc/index.php
http://algo2010.csc.liv.ac.uk/wabi/
http://algo2010.csc.liv.ac.uk/wabi.php
http://arnetminer.org/viewperson.do?naid=1070653&keyword=Bhaskar%20DasGupta
http://arxiv.org/abs/1001.2735
http://arxiv.org/abs/1102.0969
http://arxiv.org/abs/1102.1443
http://arxiv.org/abs/1110.3546
http://arxiv.org/abs/1111.3048
http://bentham.org/open/tobioij/
http://bibe2009.csie.ncu.edu.tw/index.htm
http://bicob.engr.uconn.edu/bicob/
http://binfo.ym.edu.tw/apbc2006/
http://bioinformatics.oxfordjournals.org/cgi/content/full/bti547?ijkey=HwjpMgsv0p5aV7B&keytype=ref
http://bioinformatics.oxfordjournals.org/content/21/16/3424.full?keytype=ref&ijkey=HwjpMgsv0p5aV7B
http://bioinformatics.oxfordjournals.org/lookup/resid/bti547?view=full&uritype=cgi&ijkey=HwjpMgsv0p5aV7B&keytype=ref
http://bleezer.bioengr.uic.edu/salign/
http://casb.ucsd.edu/recombccb07/
http://cil.ece.uic.edu/ICNSC08/
http://cms.csr.nih.gov/PeerReviewMeetings/CSRIRGDescriptionNew/IMSTIRG/IMST14.htm
http://coewww.rutgers.edu/ie/seminar/2008/seminar_08_09_16.htm
http://compbio.cs.uic.edu/software.html
http://counter.digits.com/wc/bhaskar
http://csb2009.org/
http://cs.uni-bonn.de/info5/teaching/rand-seminars.html
http://cs.whu.edu.cn/ibw2010/index.html
http://cui.unige.ch/tcs/random-approx/
http://dimacs.rutgers.edu/Workshops/Biomedicine/
http://dimacs.rutgers.edu/Workshops/CGT/
http://dimacs.rutgers.edu/Workshops/CompBio/
http://dimacs.rutgers.edu/Workshops/InformationProcessing/
http://dimacs.rutgers.edu/Workshops/Medical/
http://dna.engr.uconn.edu/IWBRA
http://dna.engr.uconn.edu/IWBRA/
http://dna.engr.uconn.edu/~software/barcode/
http://dx.doi.org/10.1007/11428848_129
http://dx.doi.org/10.1142/S0219720010004793
http://dx.doi.org/10.1142/S1793830910000449
http://dydan.rutgers.edu/Seminars/2008/dasgupta.html
http://dydan.rutgers.edu/Seminars/Slides/dasgupta.ppt
http://embc2006.njit.edu/
http://embc2006.njit.edu/technical/theme3.php
http://facweb.cs.depaul.edu/jrogers/STOC04.html
http://faw2009.hfut.edu.cn/
http://faw-aaim2011.zjnu.edu.cn/
http://genomics.case.edu/cpm/
http://icalp10.inria.fr/
http://icalp11.inf.ethz.ch/workshops/ga-graph-algorithms-and-applications
http://ictai05.ust.hk/
http://ictcs05.dsmi.unisi.it/
http://ieee-cis.org/members/chapters/
http://ieeexplore.ieee.org:80/xpl/RecentIssue.jsp?reload=true&punumber=72
http://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=72
http://isnn2011.mae.cuhk.edu.hk/
http://kapis.www.wkap.nl/prod/b/1-4020-0839-2
http://la-press.com/article.php?article_id=624
http://liu.ece.uic.edu/ISNN07/
http://liu.ece.uic.edu/SOLI09/
http://mechse.illinois.edu
http://meetings.siam.org/sess/dsp_programsess.cfm?SESSIONCODE=7419
http://mlaa.com.au/giw2008/
http://monod.uwaterloo.ca/events/details.php?event=4832e34c41f94
http://netlab.csu.edu.cn/ISBRA11/
http://pre.aps.org/abstract/PRE/v84/i3/e036117
http://proteomics.bioengr.uic.edu/embc-bioinfo/program.htm
http://proteomics.bioengr.uic.edu/scsb
http://proteomics.bioengr.uic.edu/scsb/
http://refworks.springer.com/algorithms/
http://research.microsoft.com/apps/dp/ev/events.aspx
http://research.microsoft.com/workshops/escience2007/
http://sagt2011.dia.unisa.it/
http://sce.uhcl.edu/bicob10/
http://sce.uhcl.edu/bicob11/
http://sce.uhcl.edu/bicob12
http://sce.uhcl.edu/bicob12/
http://scholar.google.com/citations?hl=en&user=fGcKnpIAAAAJ&view_op=list_works&is_public_preview=1
http://sigact.acm.org/sigactnews/online.html
http://spie.org/Conferences/calls/05/oe/conferences/index.cfm?fuseaction=SA108
http://spie.org/x306.xml
http://sts.bioengr.uic.edu/causal/
http://sunflower.kuicr.kyoto-u.ac.jp/apbc2008/
http://swat.diku.dk/
https://www.inderscience.com/browse/index.php?journalcode=ijbra
https://www.mses07.net/main.aspx
https://www.novapublishers.com/catalog/product_info.php?products_id=7992
http://theory.cs.uni-bonn.de/info5/teaching/rand-seminars.html
http://theory.utdallas.edu/COCOA2011/home.html
http://theory.utdallas.edu/ISAAC2009/
http://ttic.uchicago.edu/events/event_detail.php?event_id=167
http://web.eecs.utk.edu/~langston/BSB2007/index.shtml
http://webstats.motigo.com/
http://webstats.motigo.com/s?tab=1&link=1&id=3151492
http://web.umr.edu/~icnsc06/
http://www2.cs.uic.edu/~dasgupta/network-synthesis/
http://www2.lifl.fr/AICCSA2010/
http://www2.warwick.ac.uk/fac/soc/wbs/conf/co2008
http://www.aaim2009.org/
http://www.adobe.com/products/acrobat.html
http://www.adobe.com/products/acrobat/index.html
http://www.adobe.com/products/acrobat/main.html
http://www.amazon.com/Algorithms-Computational-Molecular-Biology-Bioinformatics/dp/0470505192
http://www.bentham.org/cbio/contabs/cbio4-1.htm
http://www.benthamscience.com/cbio/contabs/cbio4-1.htm
http://www.benthamscience.com/open/tobioij/
http://www.biomedcentral.com/1471-2105/8/388
http://www.cgal.org
http://www.cis.drexel.edu/faculty/thu/bibm/IEEE-BIBM2007-CFP.htm
http://www.compbio.cmu.edu/SeminarSeries.html
http://www.crcpress.co.uk/index.aspx?404;http://www.crcpress.co.uk/shopping_cart/products/product_reviews.asp
http://www.crcpress.co.uk/shopping_cart/products/product_reviews.asp?id=&parent_id=&sku=C6420&pc=
http://www.csb2009.org/
http://www.cs.cityu.edu.hk/~lwang/COCOON2005/
http://www.cs.columbia.edu/theory/s09-theoryread.html
http://www.cse.buffalo.edu/cocoon2009/
http://www.cse.fau.edu/~ictai04/
http://www.cse.psu.edu/info/colloquia/seminars.php?seminar=246
http://www.cse.psu.edu/seminar/Colloquium%20-%20DasGupta.html
http://www.cse.uconn.edu/cse_sem-conf-instance.php?id=14
http://www.cs.gsu.edu/BIBM2011/
http://www.cs.gsu.edu/ISBRA/
http://www.cs.gsu.edu/isbra08/
http://www.cs.gsu.edu/isbra09/
http://www.cs.gsu.edu/isbra12/
http://www.cs.gsu.edu/pan/iwbra.htm
http://www.cs.iit.edu/~aaim07/
http://www.cs.iit.edu/~seminar/Fall02-sem/fall02-sem.htm
http://www.cs.iit.edu/~seminar/Fall-07/fall07-oct5.html
http://www.cs.ucr.edu/~jiang/
http://www.cs.uic.edu
http://www.cs.uic.edu/
http://www.cs.uic.edu/%7Esloan
http://www.cs.uic.edu/bin/view/Main/Seminars
http://www.cs.uic.edu/~dasgupta
http://www.cs.uic.edu/~dasgupta/
http://www.cs.uic.edu/~dasgupta/bhaskar2.jpg
http://www.cs.uic.edu/~dasgupta/brief-bio.html
http://www.cs.uic.edu/~dasgupta/CFP-ISNN2012.pdf
http://www.cs.uic.edu/~dasgupta/cgc/paper.ps
http://www.cs.uic.edu/~dasgupta/coauthor-network.jpg
http://www.cs.uic.edu/~dasgupta/conf/call4paper.EMBS04.pdf
http://www.cs.uic.edu/~dasgupta/conf/call4papers-embc05.pdf
http://www.cs.uic.edu/~dasgupta/contact.html
http://www.cs.uic.edu/~dasgupta/grad-support.html
http://www.cs.uic.edu/~dasgupta/network-data/
http://www.cs.uic.edu/~dasgupta/network-data/celegans_random.zip
http://www.cs.uic.edu/~dasgupta/network-data/email_network.zip
http://www.cs.uic.edu/~dasgupta/network-data/enron-network-2.zip
http://www.cs.uic.edu/~dasgupta/network-data/jazz-random.zip
http://www.cs.uic.edu/~dasgupta/network-data/pgp.zip
http://www.cs.uic.edu/~dasgupta/network-data/PPI-random.zip
http://www.cs.uic.edu/~dasgupta/network-data/random_ecoli_Feb07.zip
http://www.cs.uic.edu/~dasgupta/network-data/random_ecolitranscriptional.zip
http://www.cs.uic.edu/~dasgupta/network-data/random_mamalian.zip
http://www.cs.uic.edu/~dasgupta/network-data/random_TLGL.zip
http://www.cs.uic.edu/~dasgupta/network-data/random_yeast.zip
http://www.cs.uic.edu/~dasgupta/network-data/resultsnew_celegans.xls
http://www.cs.uic.edu/~dasgupta/network-data/resultsnew_ecolitranscriptional.xls
http://www.cs.uic.edu/~dasgupta/network-data/resultsnew_ecoli.xls
http://www.cs.uic.edu/~dasgupta/network-data/resultsnew_enronnull.xls
http://www.cs.uic.edu/~dasgupta/network-data/resultsnew_jazz.xlsx
http://www.cs.uic.edu/~dasgupta/network-data/resultsnew_mammalian.xls
http://www.cs.uic.edu/~dasgupta/network-data/resultsnew_ppi.xlsx
http://www.cs.uic.edu/~dasgupta/network-data/resultsnewTLGL.xls
http://www.cs.uic.edu/~dasgupta/network-data/resultsnew_yeastnull.xls
http://www.cs.uic.edu/~dasgupta/network-synthesis
http://www.cs.uic.edu/~dasgupta/network-synthesis/
http://www.cs.uic.edu/~dasgupta/network-synthesis/drawgraph4.exe
http://www.cs.uic.edu/~dasgupta/network-synthesis/graph.gif
http://www.cs.uic.edu/~dasgupta/network-synthesis/help.html
http://www.cs.uic.edu/~dasgupta/network-synthesis/new-2-2.pdf
http://www.cs.uic.edu/~dasgupta/network-synthesis/old-2-2.pdf
http://www.cs.uic.edu/~dasgupta/network-synthesis/perf.pdf
http://www.cs.uic.edu/~dasgupta/network-synthesis/sample-input-file.txt
http://www.cs.uic.edu/~dasgupta/network-synthesis/sample.txt
http://www.cs.uic.edu/~dasgupta/new.gif
http://www.cs.uic.edu/~dasgupta/pc.html
http://www.cs.uic.edu/~dasgupta/professional/algo-lab.html
http://www.cs.uic.edu/~dasgupta/professional/papers/draft07.pdf
http://www.cs.uic.edu/~dasgupta/professional/prof.html
http://www.cs.uic.edu/~dasgupta/professional/recent-projects.html
http://www.cs.uic.edu/~dasgupta/professional/sciruslink.gif
http://www.cs.uic.edu/~dasgupta/professional/software.html
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/4cover.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/a1.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/a3.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/aaim-2.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/Albert_DasGupta_Sontag_chapter-4.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/allpages.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/alt00.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/apbc086a.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/approx.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/barcode-journal.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/ber3-swat04.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/Berger-WolfEtal_submission388.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/berman_dasgupta_sontag_setcover_short_21april07.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/bh.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/binary-transitive-9-revised-4.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/binary-transitive-journal-3.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/binary-transitive-wabi-4.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/bmc_article-new-2.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/book1.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/bookchap3.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/book-chapter-dasgupta-kao.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/bps-book-chapter.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/bsp.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/CDCfinal.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/cg95pap.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/chap-01.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/chap-hav-der.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/chapter1.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/cluster-kao-7.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/combined-journal-final-1.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/conf1.unix15.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/conf-sub.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/cor-greedy-final-2.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/cpm-2004-finalversion.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/csb.11pm.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/csb.cam.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/dasgupta_b.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/dbhas.dimacs.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/dmaa-09.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/draft07.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/enciso_dasgupta_sontag_2aug06.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/esl.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/final-paper.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/final-sagt-2011.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/foreword.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/f.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/icalp2010.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/ictcs-final.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/ieee.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/ijbra_barcoding_Dasgupta_et_al.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/ipf-journal.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/ipl-complete.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/jliang-align.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/joc_sibling.r3.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/jos.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/journal.stoc00.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/j.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/kao_auction.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/kinalyzer.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/lbnew.rev-sub.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/liuxx.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/lwang.chap4.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/main-tex-file.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/motif.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/mpref1.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/multicover.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/newdraft.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/nips92.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/nips95.final.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/nptcs.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/OMS_Siblings.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/palis2.rev1.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/palis.sch.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/paper1.rev2.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/paper3-wabi02.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/paper-oncover-4-wads-journal.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/pard.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/ParkingGames_ACMGIS2011_final.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/pdpta98.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/poly1.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/redundancy.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/REVIEW_PAPER_Revised-final-2.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/salign-wabi2-new.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/sch.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/search-acc2.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/search-acc.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/send_bipartite.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/setcover-v7-journal.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/Sheikh_final-paper.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/siam.sub.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/siblings_cbgi.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/SibshipChapter.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/soda-sub.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/sptas.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/sub.revised.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/syn4.final.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/tile.soda02.new.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/tiling.journal.final-sub.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/tiling.new.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/tnn04-p289.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/total1.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/tr2.ienn.rev.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/t-scenario-3-reviewed-3.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/ttiling.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/v5.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/version-6.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/wads05.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/WADS-09-final.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/wea06.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/wiley-cse.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/papers/ycyao.pdf
http://www.cs.uic.edu/~dasgupta/resume/publ/publ.html
http://www.cs.uic.edu/~dasgupta/resume/publ/top10-jal-2003.html
http://www.cs.uic.edu/~dasgupta/resume/resume/CFP-ISNN2012.pdf
http://www.cs.uic.edu/~dasgupta/resume/resume/conf/call4paper.EMBS04.pdf
http://www.cs.uic.edu/~dasgupta/resume/resume/grants.html
http://www.cs.uic.edu/~dasgupta/resume/resume/pres.ppt
http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://www.cs.uic.edu/~dasgupta/slides.html
http://www.cs.uic.edu/~dasgupta/support.html
http://www.cs.uic.edu/~dasgupta/talks/acc-2004.pdf
http://www.cs.uic.edu/~dasgupta/talks/apbc2008.ppt
http://www.cs.uic.edu/~dasgupta/talks/approx-2004.ppt
http://www.cs.uic.edu/~dasgupta/talks/biocomouting2001.pdf
http://www.cs.uic.edu/~dasgupta/talks/DIMACS-11-20021.PPT
http://www.cs.uic.edu/~dasgupta/talks/final-Presentation-toronto.ppt
http://www.cs.uic.edu/~dasgupta/talks/microsoft-eScience-2007.ppt
http://www.cs.uic.edu/~dasgupta/talks/pres1.pdf
http://www.cs.uic.edu/~dasgupta/talks/sagt-2011.ppt
http://www.cs.uic.edu/~dasgupta/talks/siblings.ppt
http://www.cs.uic.edu/~dasgupta/talks/swat04.pdf
http://www.cs.uic.edu/~dasgupta/talks/talk-ttic.ppt
http://www.cs.uic.edu/~dasgupta/talks/uic-bioe-symp-2004.ppt
http://www.cs.uic.edu/~dasgupta/talks/uwm-math.ppt
http://www.cs.uic.edu/~dasgupta/theorypage/theory-event-cs.html
http://www.cs.uic.edu/~dasgupta/theorypage/theory-group.html
http://www.cs.uic.edu/~dasgupta/theorypage/title-abs-borodin.html
http://www.cs.uic.edu/~dasgupta/theorypage/title-abs-jason.html
http://www.cs.uic.edu/~dasgupta/theorypage/title-abs-jinyicai.html
http://www.cs.uic.edu/~dasgupta/theorypage/title-abs-joan.html
http://www.cs.uic.edu/~dasgupta/theorypage/title-abs-ketan.html
http://www.cs.uic.edu/~dasgupta/theorypage/title-abs-schapira.html
http://www.cs.uic.edu/~dasgupta/undergrad-support.html
http://www.cs.uic.edu/~dasgupta/wc-01.gif
http://www.cs.uic.edu/Main/NewsItem?audience=public&ind=400
http://www.cs.uic.edu/~sloan/
http://www.cs.uic.edu/~tanyabw
http://www.cs.uic.edu/~tanyabw/
http://www.cs.umass.edu/csinfo/colloquia/DEPT/dasgupta.html
http://www.cs.umd.edu/areas/Theory/CATS/
http://www.cs.utk.edu/~langston/BSB2007/index.shtml
http://www.cs.uu.nl/CGAL/
http://www.cs.uu.nl/geobook
http://www.cs.uu.nl/geobook/
http://www.cs.uwaterloo.ca/~mli/
http://www.cs.uwm.edu/~ccheng/Seminar/Abstracts/dasgupta.html
http://www.dartmouth.edu/~bioc2005/
http://www.digits.com/
http://www.dis.uniroma1.it/%7Ealgo02/wabi02/
http://www.dis.uniroma1.it/algo02/wabi02/
http://www.ee.cuhk.edu.hk/EMBC05shanghai
http://www.ee.cuhk.edu.hk/EMBC05shanghai/technical.htm
http://www.elsevier.com/homepage/sac/050/images/spacer.gif
http://www.elsevier.com/wps/cwsredirect/homepage/sac/050/images/spacer.gif
http://www.elsevier.com/wps/find/journaldescription.cws_home/239/description
http://www.elsevier.com/wps/find/journaldescription.cws_home/300/description
http://www.elsevier.com/wps/find/journaldescription.cws_home/505612/description
http://www.elsevier.com/wps/find/journaldescription.cws_home/506017/description
http://www.elsevier.com/wps/find/journaldescription.cws_home/841/description
http://www.elsevier.com/wps/find/simple_content.cws_home/pagenotfound
http://www.elseviermathematics.com/mathematicsweb/artwork/.Present/Images/elsevier_m.gif
http://www.elseviermathematics.com/mathematicsweb/artwork/.Present/Images/mathheader.gif
http://www.engineering.uiowa.edu/faw
http://www.engineering.uiowa.edu/faw/
http://www.ezconf.net/icnsc10/
http://www.ftrg.org/futuretech2010/
http://www.ftrg.org/futuretech2011/index.html
http://www.gimac.uma.es/foci2011/Main.html
http://www.gnu.org/licenses/gpl.html
http://www.hindawi.com/journals/ab/editors/
http://www.hindawi.com/journals/ab/editors.html
http://www.hindawi.com/journals/ab/editors.html/
http://www.hindawi.com/journals/abi/editors/
http://www.hindawi.com/journals/abi/editors.html
http://www.hindawi.com/journals/abi/editors.html/
http://www.iasted.org/conferences/2006/dallas/csb.htm
http://www.iasted.org/conferences/home-634.html
http://www.iasted.org/conferences/home-689.html
http://www.iasted.org/conferences/pastinfo-540.html
http://www.iasted.org/conferences/pastinfo-634.html
http://www.iasted.org/conferences/pastinfo-689.html
http://www.iasted.org/conferences/pipc.aspx?id=770&contact=39767465
http://www.iccabs.org/
http://www.ieee-icnsc07.org/
http://www.ijisce.org/
http://www.imada.sdu.dk/Research/Digraphs/
http://www.imtnagpur.ac.in/itbi10/INNS/Committees.html
http://www.inderscience.com/browse/index.php
http://www.inderscience.com/browse/index.php?journalCODE=ijdmb
http://www.informatik.uni-trier.de/~ley/db/indices/a-tree/d/DasGupta:Bhaskar.html
http://www.iscb.org/cms_addon/conferences/ismbeccb2007/
http://www.iscb.org/ismbeccb2007/
http://www.ischool.drexel.edu/ieeebibm/bibm08/about/bibm-about.asp
http://www.ittc.ku.edu/bioinformatics/BIBM09/home.php
http://www.jcis.org/
http://www.jcis.org/pages/subconference/cbgi/cbgi.aspx
http://www.journals.elsevier.com/biosystems/
http://www.journals.elsevier.com/computers-and-operations-research/
http://www.journals.elsevier.com/information-processing-letters/
http://www.journals.elsevier.com/locate/pubidt/239
http://www.journals.elsevier.com/locate/pubidt/300
http://www.journals.elsevier.com/locate/pubidt/505612
http://www.journals.elsevier.com/locate/pubidt/506017
http://www.journals.elsevier.com/locate/pubidt/841
http://www.journals.elsevier.com/neural-networks/
http://www.journals.elsevier.com/nonlinear-analysis-theory-methods-and-applications/
http://www.journals.wspc.com.sg/dmaa/dmaa.shtml
http://www.la-press.com/article.php?article_id=624
http://www.la-press.com/biomedical-engineering-and-computational-biology-journal-j170
http://www.la-press.com/introductory-editorial-theoretical-biology-insights-article-a624
http://www.liebertpub.com/products/product.aspx?pid=31
http://www.liebertpub.com/publication.aspx?pub_id=31
http://www.lsi.upc.edu/~wea/
http://www.marquiswhoswho.com
http://www.math.hkbu.edu.hk/BIBM2010/index.html
http://www.math.rutgers.edu/~sontag/
http://www.math.rutgers.edu/~sontag/desz_README.html
http://www.math.uic.edu/PeledWorkshop/
http://www.math.uic.edu/PeledWorkshop/index.php
http://www.mie.uiuc.edu/acc2004/
http://www.mobilephonedealscompare.co.uk
http://www.nedstatbasic.net/
http://www.nedstatbasic.net/stats?ADAWhAVPAqWiTjvHhfuLI0wAaocw
http://www.ntu.edu.sg/home/assourav/bidm/2004/main.html
http://www.ntu.edu.sg/home/assourav/bidm/2005/main.html
http://www.nvc.cs.vt.edu/ictai06/
http://www.nyas.org/annals/detail.asp?annalID=891
http://www.nyas.org/Events/Detail.aspx?cid=16526236-c118-49e4-9752-538d1b0c1f2f
http://www.optimization-in-finance.ca/
http://www.or.deis.unibo.it/knapsack.html
http://WWW.PROCESSREQUEST.COM/apps/msgopen.asp?id=1528992,ZchfdahjafDI&oid=UdeaiBF&taskid=WbfibcaBH
http://www.ProcessRequest.com/apps/redir.asp?link=XbggbfgcCH,ZchfdahjafDI&oid=UdeaiBF&iclitemid=XbfcijjcDG&tid=WbfibcaBH
http://www.ProcessRequest.com/apps/redir.asp?link=XbggbfgdCI,ZchfdahjafDI&oid=UdeaiBF&iclitemid=XbfcijjcDG&tid=WbfibcaBH
http://www.ProcessRequest.com/apps/redir.asp?link=XbggbfgeCJ,ZchfdahjafDI&oid=UdeaiBF&iclitemid=XbfcijjcDG&tid=WbfibcaBH
http://www.ProcessRequest.com/apps/redir.asp?link=XbggbfgfDA,ZchfdahjafDI&oid=UdeaiBF&iclitemid=XbfcijjcDG&tid=WbfibcaBH
http://www.ProcessRequest.com/apps/redir.asp?link=XbggbfggDB,ZchfdahjafDI&oid=UdeaiBF&iclitemid=XbfcijjcDG&tid=WbfibcaBH
http://www.ProcessRequest.com/apps/redir.asp?link=XbggbfghDC,ZchfdahjafDI&oid=UdeaiBF&iclitemid=XbfcijjcDG&tid=WbfibcaBH
http://www.ProcessRequest.com/apps/redir.asp?link=XbggbfgiDD,ZchfdahjafDI&oid=UdeaiBF&iclitemid=XbfcijjcDG&tid=WbfibcaBH
http://www.ProcessRequest.com/apps/redir.asp?link=XbggbfgjDE,ZchfdahjafDI&oid=UdeaiBF&iclitemid=XbfcijjcDG&tid=WbfibcaBH
http://www.ProcessRequest.com/apps/redir.asp?link=XbggbfhaCG,ZchfdahjafDI&oid=UdeaiBF&iclitemid=XbfcijjcDG&tid=WbfibcaBH
http://www.ProcessRequest.com/apps/redir.asp?link=XbggbfhbCH,ZchfdahjafDI&oid=UdeaiBF&iclitemid=XbfcijjcDG&tid=WbfibcaBH
http://www.ProcessRequest.com/apps/redir.asp?link=XbggbfhcCI,ZchfdahjafDI&oid=UdeaiBF&iclitemid=XbfcijjcDG&tid=WbfibcaBH
http://www.ProcessRequest.com/apps/redir.asp?link=XbggbfhdCJ,ZchfdahjafDI&oid=UdeaiBF&iclitemid=XbfcijjcDG&tid=WbfibcaBH
http://www.ProcessRequest.com/apps/redir.asp?link=XbggbfhfDB,ZchfdahjafDI&oid=UdeaiBF&iclitemid=XbfcijjcDG&tid=WbfibcaBH
http://www.ProcessRequest.com/apps/redir.asp?link=XbggbfhgDC,ZchfdahjafDI&oid=UdeaiBF&iclitemid=XbfcijjcDG&tid=WbfibcaBH
http://www.processrequest.com/quickstart/switchformat.asp?c=ZchfdahjafDI
http://www.sciencedirect.com/science/journal/00220000
http://www.sciencedirect.com/science?_ob=PublicationURL&_tockey=%23TOC%235629%232007%23998449993%23643946%23FLA%23&_cdi=5629&_pubType=J&view=c&_auth=y&_acct=C000013678&_version=1&_urlVersion=0&_userid=186797&md5=7b030d4b9e3f7d757c14d94c8dc3c984
http://www.scirus.com/
http://www.sigact.org/sigactnews/online.html
http://www.sofsem.cz/sofsem12/index.php
http://www.springer.com/computer/theoretical+computer+science/journal/453
http://www.springer.com/computer/theoretical+computer+science/journal/453?changeHeader=true&detailsPage=description
http://www.springer.com/computer/theoretical+computer+science/journal/453?detailsPage=description&SHORTCUT=www.springer.com/journal/00453/about&changeHeader=true
http://www.springer.com/education+%26+language/learning+%26+instruction/book/978-1-4419-1427-9
http://www.springer.com/engineering/biomedical+eng/book/978-1-4020-0641-8?cm_cmm=sgw-_-ps-_-book-_-1-4020-0641-1
http://www.springer.com/prod/b/1-4020-0641-1?referer=www.wkap.nl
http://www.springer.com/west/home?SGWID=4-102-70-1083191-detailsPage=journal|description&changeHeader=true&SHORTCUT=www.springer.com/journal/00453/about
http://www.springerlink.com/content/41542h1835k67801/
http://www.springerlink.com/content/jbc2h9vmutkthpp1/
http://www.springerlink.com/content/vhl827026547/?p=6a863bc5d0a2454b92ecb996ec6a8076&pi=0
http://www.springerlink.com/index/10.1007/11428848_129
http://www.springerprotocols.com/BookToc/doi/10.1007/978-1-60761-842-3
http://www.support-vector.net
http://www.ucsfresno.edu/embs2004/
http://www.uic.edu
http://www.uic.edu/depts/bioe/faculty/bioinfo_fac.htm
http://www.uic.edu/depts/bioe/main/sympBioinformatics.htm
http://www.uic.edu/uic/
http://www.utoronto.ca/reg/list_notices_p.pl?dept=csci&time_frame=year
http://www.wabi07.org/
http://www.wads.org
http://www.wads.org/
http://www.wasaconf.org/wasa2008/index.html
http://www.wiley.com/WileyCDA/WileyTitle/productCd-0470505192.html
http://www.wisdom.weizmann.ac.il/~oded/foc-vol1.html
http://www.wkap.nl/prod/b/1-4020-0641-1
http://www.worldscibooks.com/lifesci/p544.html
http://www.worldscibooks.com/lifesci/p585.html
http://www.worldscinet.com/dmaa/02/0201/S1793830910000449.html
http://www.worldscinet.com/jbcb/08/0802/S0219720010004793.html
jakob@ubuntu:~/cs450/main/solutions/hw10$ cat broken
http://bibe2009.csie.ncu.edu.tw/index.htm from http://www.cs.uic.edu/~dasgupta/pc.html
http://bibe2009.csie.ncu.edu.tw/index.htm from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://bicob.engr.uconn.edu/bicob/ from http://www.cs.uic.edu/~dasgupta/pc.html
http://bicob.engr.uconn.edu/bicob/ from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://cil.ece.uic.edu/ICNSC08/ from http://www.cs.uic.edu/~dasgupta/pc.html
http://cil.ece.uic.edu/ICNSC08/ from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://cs.whu.edu.cn/ibw2010/index.html from http://www.cs.uic.edu/~dasgupta/pc.html
http://cs.whu.edu.cn/ibw2010/index.html from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://faw2009.hfut.edu.cn/ from http://www.cs.uic.edu/~dasgupta/pc.html
http://faw2009.hfut.edu.cn/ from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://liu.ece.uic.edu/ISNN07/ from http://www.cs.uic.edu/~dasgupta/pc.html
http://liu.ece.uic.edu/ISNN07/ from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://liu.ece.uic.edu/SOLI09/ from http://www.cs.uic.edu/~dasgupta/pc.html
http://liu.ece.uic.edu/SOLI09/ from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://netlab.csu.edu.cn/ISBRA11/ from http://www.cs.uic.edu/~dasgupta/pc.html
http://netlab.csu.edu.cn/ISBRA11/ from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://web.umr.edu/~icnsc06/ from http://www.cs.uic.edu/~dasgupta/pc.html
http://web.umr.edu/~icnsc06/ from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://www.cs.cityu.edu.hk/~lwang/COCOON2005/ from http://www.cs.uic.edu/~dasgupta/pc.html
http://www.cs.cityu.edu.hk/~lwang/COCOON2005/ from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://www.cse.fau.edu/~ictai04/ from http://www.cs.uic.edu/~dasgupta/pc.html
http://www.cse.fau.edu/~ictai04/ from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://www.cs.iit.edu/~aaim07/ from http://www.cs.uic.edu/~dasgupta/pc.html
http://www.cs.iit.edu/~aaim07/ from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://bleezer.bioengr.uic.edu/salign/ from http://www.cs.uic.edu/~dasgupta/professional/software.html
http://compbio.cs.uic.edu/software.html from http://www.cs.uic.edu/~dasgupta/professional/software.html
http://www.cs.uic.edu/~dasgupta/professional/papers/draft07.pdf from http://www.cs.uic.edu/~dasgupta/professional/software.html
http://150.135.155.192/icnsc/index.php from http://www.cs.uic.edu/~dasgupta/resume/publ/publ.html
http://genomics.case.edu/cpm/ from http://www.cs.uic.edu/~dasgupta/resume/publ/publ.html
http://ictcs05.dsmi.unisi.it/ from http://www.cs.uic.edu/~dasgupta/resume/publ/publ.html
http://kapis.www.wkap.nl/prod/b/1-4020-0839-2 from http://www.cs.uic.edu/~dasgupta/resume/publ/publ.html
http://refworks.springer.com/algorithms/ from http://www.cs.uic.edu/~dasgupta/resume/publ/publ.html
http://www.cs.uic.edu/~dasgupta/network-data/random_yeast.zip from http://www.cs.uic.edu/~dasgupta/network-data/
http://coewww.rutgers.edu/ie/seminar/2008/seminar_08_09_16.htm from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://www.cse.psu.edu/info/colloquia/seminars.php?seminar=246 from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://www.cse.psu.edu/seminar/Colloquium%20-%20DasGupta.html from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://www.cse.uconn.edu/cse_sem-conf-instance.php?id=14 from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://www.cs.uic.edu/~dasgupta/resume/resume/CFP-ISNN2012.pdf from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://www.cs.uic.edu/~dasgupta/resume/resume/conf/call4paper.EMBS04.pdf from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
https://www.mses07.net/main.aspx from http://www.cs.uic.edu/~dasgupta/slides.html
http://www.dartmouth.edu/~bioc2005/ from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://www.ee.cuhk.edu.hk/EMBC05shanghai from http://www.cs.uic.edu/~dasgupta/pc.html
http://www.ee.cuhk.edu.hk/EMBC05shanghai from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://www.ee.cuhk.edu.hk/EMBC05shanghai/technical.htm from http://www.cs.uic.edu/~dasgupta/pc.html
http://www.ee.cuhk.edu.hk/EMBC05shanghai/technical.htm from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://www.elseviermathematics.com/mathematicsweb/artwork/.Present/Images/elsevier_m.gif from http://www.cs.uic.edu/~dasgupta/resume/publ/top10-jal-2003.html
http://www.elseviermathematics.com/mathematicsweb/artwork/.Present/Images/mathheader.gif from http://www.cs.uic.edu/~dasgupta/resume/publ/top10-jal-2003.html
http://www.gimac.uma.es/foci2011/Main.html from http://www.cs.uic.edu/~dasgupta/pc.html
http://www.gimac.uma.es/foci2011/Main.html from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://www.hindawi.com/journals/ab/editors.html from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://www.imada.sdu.dk/Research/Digraphs/ from http://www.cs.uic.edu/~dasgupta/professional/prof.html
http://www.math.uic.edu/PeledWorkshop/ from http://www.cs.uic.edu/~dasgupta/theorypage/theory-event-cs.html
http://www.math.uic.edu/PeledWorkshop/index.php from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://www.aaim2009.org/ from http://www.cs.uic.edu/~dasgupta/professional/software.html
http://www.aaim2009.org/ from http://www.cs.uic.edu/~dasgupta/resume/publ/publ.html
http://www.sciencedirect.com/science/journal/00220000 from http://www.cs.uic.edu/~dasgupta/professional/software.html
http://www.sciencedirect.com/science/journal/00220000 from http://www.cs.uic.edu/~dasgupta/resume/publ/publ.html
http://www.sciencedirect.com/science?_ob=PublicationURL&_tockey=%23TOC%235629%232007%23998449993%23643946%23FLA%23&_cdi=5629&_pubType=J&view=c&_auth=y&_acct=C000013678&_version=1&_urlVersion=0&_userid=186797&md5=7b030d4b9e3f7d757c14d94c8dc3c984 from http://www.cs.uic.edu/~dasgupta/resume/publ/publ.html
http://sigact.acm.org/sigactnews/online.html from http://www.cs.uic.edu/~dasgupta/professional/prof.html
http://www.ucsfresno.edu/embs2004/ from http://www.cs.uic.edu/~dasgupta/pc.html
http://www.ucsfresno.edu/embs2004/ from http://www.cs.uic.edu/~dasgupta/professional/software.html
http://www.ucsfresno.edu/embs2004/ from http://www.cs.uic.edu/~dasgupta/resume/publ/publ.html
http://www.ucsfresno.edu/embs2004/ from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://www.uic.edu/depts/bioe/faculty/bioinfo_fac.htm from http://www.cs.uic.edu/~dasgupta/
http://www.uic.edu/depts/bioe/main/sympBioinformatics.htm from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html
http://www.wasaconf.org/wasa2008/index.html from http://www.cs.uic.edu/~dasgupta/pc.html
http://www.wasaconf.org/wasa2008/index.html from http://www.cs.uic.edu/~dasgupta/resume/resume/resume.html

$./hw10 http://logos.cs.uic.edu/reed/ summary visited checked broken

jakob@ubuntu:~/cs450/main/solutions/hw10$ cat summary
Visited_pages: 19
Checked_URLs: 273
Broken_URLs: 50
jakob@ubuntu:~/cs450/main/solutions/hw10$ cat visited
http://logos.cs.uic.edu/reed/
http://logos.cs.uic.edu/reed/ACADEMICS/MSDNAA/index.html
http://logos.cs.uic.edu/reed/FUN/Fun.html
http://logos.cs.uic.edu/reed/FUN/FunnyQuizzes.html
http://logos.cs.uic.edu/reed/Papers/Dissertation%20Links.htm
http://logos.cs.uic.edu/reed/Papers/Intelligent%20Indexing%20ICTE%20paper.htm
http://logos.cs.uic.edu/reed/Papers/KBS%20Paper%202.htm
http://logos.cs.uic.edu/reed/Papers/Web%20Page%20Annotator%20ICTE%20paper.htm
http://logos.cs.uic.edu/reed/PERSONAL/Christianity/info.html
http://logos.cs.uic.edu/reed/PERSONAL/index.html
http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/pics/ASCIIPortraitFromGlassGiantDotCom.htm
http://logos.cs.uic.edu/reed/PERSONAL/pics/info.html
http://logos.cs.uic.edu/reed/PERSONAL/pics/LoseTheBeard.html
http://logos.cs.uic.edu/reed/PERSONAL/resume.html
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/index.html
http://logos.cs.uic.edu/reed/PERSONAL/WarpIt/info.html
http://logos.cs.uic.edu/reed/ProjectIdeas.html
http://logos.cs.uic.edu/reed/Teaching.html
jakob@ubuntu:~/cs450/main/solutions/hw10$ cat checked
http://ascii.mastervb.net/
http://cvcl.mit.edu/hybridimage.htm
http://download.cnet.com/Graph-Paper-Printer/3000-2064_4-10037453.html
http://e5.onthehub.com/WebStore/ProductsByMajorVersionList.aspx?ws=3df7340e-7e9b-e011-969d-0030487d8897&vsro=8
http://e5.onthehub.com/WebStore/Welcome.aspx?vsro=8&ws=3DF7340E-7E9B-E011-969D-0030487D8897
http://en.wikipedia.org/wiki/File:Minard.png
http://en.wikipedia.org/wiki/Image:Minard.png
http://futureoftheinternet.org/
http://go.hrw.com/atlas
http://interact.uoregon.edu/MediaLit/FA/MLArticleFolder/bloop.html
http://logos.cs.uic.edu/101/index.html
http://logos.cs.uic.edu/101/WWW/Welcome.html
http://logos.cs.uic.edu/102
http://logos.cs.uic.edu/102/
http://logos.cs.uic.edu/109/
http://logos.cs.uic.edu/266/index.htm
http://logos.cs.uic.edu/335
http://logos.cs.uic.edu/335/
http://logos.cs.uic.edu/335Archive/335%20Ethics%20Fall%2002/index.html
http://logos.cs.uic.edu/335Archive/335%20Ethics%20Spring%2002/index.html
http://logos.cs.uic.edu/335Archive/335%20Ethics%20Spring%2003/index.html
http://logos.cs.uic.edu/335Archive/335Fall05/index.html
http://logos.cs.uic.edu/335Archive/335Spring07/index.html
http://logos.cs.uic.edu/335Archive/375%20Ethics%20Spring%2001/index.htm
http://logos.cs.uic.edu/340
http://logos.cs.uic.edu/340/
http://logos.cs.uic.edu/340Archive/340Fall04/index.html
http://logos.cs.uic.edu/340/index.html
http://logos.cs.uic.edu/366Archive/366Fall03/index.html
http://logos.cs.uic.edu/366Archive/366Fall04/index.html
http://logos.cs.uic.edu/366/index.html
http://logos.cs.uic.edu/376
http://logos.cs.uic.edu/376/
http://logos.cs.uic.edu/385
http://logos.cs.uic.edu/385/
http://logos.cs.uic.edu/476
http://logos.cs.uic.edu/476/
http://logos.cs.uic.edu/476Archive/476%20ProgLang%20Fall%2097/index.htm
http://logos.cs.uic.edu/Annotator
http://logos.cs.uic.edu/Annotator/
http://logos.cs.uic.edu/APCS/index.htm
http://logos.cs.uic.edu/CFX
http://logos.cs.uic.edu/CFX2/MainUI2.jsp
http://logos.cs.uic.edu/Intro%20Prog/102Fall05/
http://logos.cs.uic.edu/Intro%20Prog/102Fall06/
http://logos.cs.uic.edu/Intro%20Prog/102Fall07/
http://logos.cs.uic.edu/Intro%20Prog/102Fall08/
http://logos.cs.uic.edu/Intro%20Prog/102Fall09/
http://logos.cs.uic.edu/Intro%20Prog/102Fall10/
http://logos.cs.uic.edu/Intro%20Prog/102Spring02/index.htm
http://logos.cs.uic.edu/Intro%20Prog/102Spring03/index.htm
http://logos.cs.uic.edu/Intro%20Prog/102Spring08/
http://logos.cs.uic.edu/Intro%20Prog/102Spring09/
http://logos.cs.uic.edu/Intro%20Prog/102Spring10/
http://logos.cs.uic.edu/Intro%20Prog/102Spring11/
http://logos.cs.uic.edu/Intro%20Prog/107Fall02/index.htm
http://logos.cs.uic.edu/Intro%20Prog/107Fall08/
http://logos.cs.uic.edu/Intro%20Prog/107Fall10/
http://logos.cs.uic.edu/Intro%20Prog/107Spring04/
http://logos.cs.uic.edu/Intro%20Prog/107Spring09/
http://logos.cs.uic.edu/Intro%20Prog/107Spring10/
http://logos.cs.uic.edu/Intro%20Prog/107Spring11/
http://logos.cs.uic.edu/Intro%20Prog/171%20Spring%2001/index.htm
http://logos.cs.uic.edu/IT101/
http://logos.cs.uic.edu/IT101%20Fall%2006/
http://logos.cs.uic.edu/IT101%20Spring%2006/
http://logos.cs.uic.edu/recruit
http://logos.cs.uic.edu/recruit/
http://logos.cs.uic.edu/reed
http://logos.cs.uic.edu/reed/
http://logos.cs.uic.edu/reed/ACADEMICS/MSDNAA/index.html
http://logos.cs.uic.edu/reed/CLASSES/info.html
http://logos.cs.uic.edu/reed/FUN/Fun.html
http://logos.cs.uic.edu/reed/FUN/FunnyQuizzes.html
http://logos.cs.uic.edu/reed/FUN/marey_train-schedule.jpg
http://logos.cs.uic.edu/reed/FUN/Minard.png
http://logos.cs.uic.edu/reed/FUN/mojopac.com
http://logos.cs.uic.edu/reed/FUN/reedSimpson.jpeg
http://logos.cs.uic.edu/reed/FUN/salmon.asf
http://logos.cs.uic.edu/reed/FUN/tinyurl.com/y9499k
http://logos.cs.uic.edu/reed/FUN/triangles.jpg
http://logos.cs.uic.edu/reed/FUN/u3.com
http://logos.cs.uic.edu/reed/FUN/WhatColor.JPG
http://logos.cs.uic.edu/reed/GerardoVideo.wmv
http://logos.cs.uic.edu/reed/Grants/CCLIProposal.pdf
http://logos.cs.uic.edu/reed/Grants/NSFSSCProposal.pdf
http://logos.cs.uic.edu/reed/Grants/PFSMETEProposal.pdf
http://logos.cs.uic.edu/reed/O%20Holy%20Night.mp3
http://logos.cs.uic.edu/reed/Papers/ASEE%202002%20Lecturer%20Paper3.pdf
http://logos.cs.uic.edu/reed/Papers/Dissertation%20Links.htm
http://logos.cs.uic.edu/reed/Papers/Dissertation.PDF
http://logos.cs.uic.edu/reed/Papers/FIE92Paper.pdf
http://logos.cs.uic.edu/reed/Papers/ICTE93Paper.pdf
http://logos.cs.uic.edu/reed/Papers/ICTE96Paper.pdf
http://logos.cs.uic.edu/reed/Papers/Intelligent%20Indexing%20ICTE%20paper.htm
http://logos.cs.uic.edu/reed/Papers/KBS%20Paper%202.htm
http://logos.cs.uic.edu/reed/Papers/SIGCSE04Paper2.doc
http://logos.cs.uic.edu/reed/Papers/SIGCSE04Paper3.pdf
http://logos.cs.uic.edu/reed/Papers/SIGCSEAnnotatorPaper.pdf
http://logos.cs.uic.edu/reed/Papers/Web%20Page%20Annotator%20ICTE%20paper.htm
http://logos.cs.uic.edu/reed/PERSONAL/Christianity/info.html
http://logos.cs.uic.edu/reed/PERSONAL/giraffian.com/kids
http://logos.cs.uic.edu/reed/PERSONAL/howstuffworks.com
http://logos.cs.uic.edu/reed/PERSONAL/index.html
http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/macromedia.com
http://logos.cs.uic.edu/reed/PERSONAL/micro.magnet.fsu.edu
http://logos.cs.uic.edu/reed/PERSONAL/microsoft.com
http://logos.cs.uic.edu/reed/PERSONAL/nasa.gov
http://logos.cs.uic.edu/reed/PERSONAL/pbskids.org/zoom
http://logos.cs.uic.edu/reed/PERSONAL/pics/ASCIIPortraitFromGlassGiantDotCom.htm
http://logos.cs.uic.edu/reed/PERSONAL/pics/Beard1.jpg
http://logos.cs.uic.edu/reed/PERSONAL/pics/Dale_Goo.jpg
http://logos.cs.uic.edu/reed/PERSONAL/pics/Desiree1.jpg
http://logos.cs.uic.edu/reed/PERSONAL/pics/Desiree2.jpg
http://logos.cs.uic.edu/reed/PERSONAL/pics/info.html
http://logos.cs.uic.edu/reed/PERSONAL/pics/Justice.jpg
http://logos.cs.uic.edu/reed/PERSONAL/pics/kidsXmas02.JPG
http://logos.cs.uic.edu/reed/PERSONAL/pics/kidsXmas03.JPG
http://logos.cs.uic.edu/reed/PERSONAL/pics/KidsXmas05.JPG
http://logos.cs.uic.edu/reed/PERSONAL/pics/LoseTheBeard.html
http://logos.cs.uic.edu/reed/PERSONAL/pics/ReedPortrait.JPG
http://logos.cs.uic.edu/reed/PERSONAL/pics/The_Boys.jpg
http://logos.cs.uic.edu/reed/PERSONAL/pics/Tirzah.jpg
http://logos.cs.uic.edu/reed/PERSONAL/resume.html
http://logos.cs.uic.edu/reed/PERSONAL/scientificsonline.com
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/01DadPrep.jpg
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/01DalePrep.jpg
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/01RobPrep.jpg
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/02Airplane.jpg
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/03Altimiter.jpg
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/04Jumping1.jpg
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/04Jumping2.jpg
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/04Jumping3.jpg
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/04Jumping4.jpg
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/04Jumping5.jpg
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/05InTheAir6.jpg
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/05InTheAir7.jpg
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/07PullingTheRipCord1.jpg
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/08ChuteOpening2.jpg
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/08ChuteOpening3.jpg
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/09ViewFrom5Kft.jpg
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/10Landing1.jpg
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/12DadDaleRobOnGround2.jpg
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/13SkyDiveVideo.avi
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/index.html
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/www.skydivecsc.com
http://logos.cs.uic.edu/reed/PERSONAL/WarpIt/info.html
http://logos.cs.uic.edu/reed/PERSONAL/www.bionicle.com
http://logos.cs.uic.edu/reed/PERSONAL/www.bonus.com
http://logos.cs.uic.edu/reed/PERSONAL/www.exploratorium.edu
http://logos.cs.uic.edu/reed/PERSONAL/www.geocities.com/mrsmartens
http://logos.cs.uic.edu/reed/PERSONAL/www.grc.nasa.gov/WWW/K-12
http://logos.cs.uic.edu/reed/PERSONAL/www.ipl.org/kidspace
http://logos.cs.uic.edu/reed/PERSONAL/www.jagex.com
http://logos.cs.uic.edu/reed/PERSONAL/www.justiceR.homestead.com
http://logos.cs.uic.edu/reed/PERSONAL/www.nationalgeographic.com
http://logos.cs.uic.edu/reed/PERSONAL/www.runescape.com
http://logos.cs.uic.edu/reed/PERSONAL/www.scitoys.com
http://logos.cs.uic.edu/reed/PERSONAL/www.shodor.org/interactivate
http://logos.cs.uic.edu/reed/PERSONAL/www.si.edu/kids
http://logos.cs.uic.edu/reed/PERSONAL/www.spacekids.com
http://logos.cs.uic.edu/reed/PERSONAL/www.squeakland.org
http://logos.cs.uic.edu/reed/Presentations/12-04%20Tablet%20Tools%20for%20Teaching2.mht
http://logos.cs.uic.edu/reed/ProjectIdeas.html
http://logos.cs.uic.edu/reed/SIGreed.png
http://logos.cs.uic.edu/reed/Teaching.html
http://logos.cs.uic.edu/reed/What%20I've%20learned%20about%20teaching_files/image002.jpg
http://logos.cs.uic.edu/reed/What%20I've%20learned%20about%20teaching_files/image004.gif
http://logos.cs.uic.edu/reed/What%20I've%20learned%20about%20teaching_files/image006.gif
http://logos.cs.uic.edu/reed/What%20I've%20learned%20about%20teaching_files/image008.gif
http://logos.cs.uic.edu/reed/What%20I've%20learned%20about%20teaching_files/image010.jpg
http://logos.cs.uic.edu/reed/What%20I've%20learned%20about%20teaching_files/image012.gif
http://logos.cs.uic.edu/reed/What%20I've%20learned%20about%20teaching_files/image014.gif
http://logos.cs.uic.edu/reed/Wordle%20Computer%20Science.jpg
http://logos.cs.uic.edu/UIC%20CS%20Info%20PowerPoint/CS%20job%20slides.ppt
http://logos.cs.uic.edu/UIC%20CS%20Info%20PowerPoint/Intro%20UIC.ppt
http://logos.cs.uic.edu/UIC%20CS%20Info%20PowerPoint/JasonLeighPresentation.ppt
http://logos.eecs.uic.edu/reed
http://logos.eecs.uic.edu/reed/
http://msdn01.e-academy.com/elms/Storefront/Home.aspx?campus=uic_cs
http://msdn01.e-academy.com/uic_cs/
http://pdos.csail.mit.edu/scigen/
http://PortableApps.com
http://pw1.netcom.com/%7Erlederer
http://pw1.netcom.com/%7Erlederer/rllink.htm
http://pw1.netcom.com/~rlederer/
http://scientificsonline.com/
http://services.alphaworks.ibm.com/manyeyes/browse/visualizations
https://sites.google.com/site/uic107/
https://sites.google.com/site/uiccs102/
https://www.cia.gov/redirects/factbookredirect.html
http://tinyurl.com/
http://urbantapestries.net/
http://wordle.net/create
http://www1.idc.ac.il/tecs/software.html
http://www.abandonkeep.com
http://www.apachefriends.org/en/xampp.html
http://www.apologeticsindex.org/v00.html
http://www.axlrosen.net/
http://www.babynamewizard.com/voyager
http://www.biblegateway.com
http://www.biblegateway.com/
http://www.biblegateway.com/?language=English&version=NIV
http://www.billygraham.org/believe/stepsToPeace.asp
http://www.bitsbook.com/
http://www.bls.gov/news.release/ecopro.t03.htm
http://www.bls.gov/news.release/ecopro.t04.htm
http://www.bls.gov/news.release/ecopro.toc.htm
http://www.ceedo.com
http://www.cia.gov/cia/publications/factbook/
http://www.clickinks.com/printing-graph-paper.html
http://www.crh.noaa.gov
http://www.crh.noaa.gov/crh/
http://www.cs.uic.edu
http://www.cs.uic.edu/
http://www.cs.uic.edu/Scholarship
http://www.darwinawards.com/
http://www.datavis.ca/gallery/timelines.php
http://www.di.uniovi.es/%7Ecernuda/noprog_ENG.html
http://www.earthlink.net/error/404.faces
http://www.earthlink.net/error/404/index.html
http://www.edwardtufte.com/tufte/index
http://www.edweek.org/ew/tc/index.html
http://www.edweek.org/rc/articles/2004/10/15/tc-archive.html
http://www.edweek.org/sreports/tc99/
http://www.everystudent.com
http://www.freeantennas.com
http://www.freeantennas.com/projects/template2/index.html
http://www.glassgiant.com/ascii/
http://www.gospelcom.net
http://www.gospelcom.net/bible?language=English&version=NIV
http://www.grand-illusions.com/images/articles/opticalillusions/dragon_illusion/dragon.pdf
http://www.grand-illusions.com/opticalillusions/dragon_illusion/
http://www.grand-illusions.com/shop.htm
http://www.historyshots.com/ViewInfo.cfm?Type=zoom&PID=1010
http://www.ibm.com/
http://www.ibm.com/us/en/
http://www.improbable.com/
http://www.improbable.com/ig/ig-top.html
http://www.inference.phy.cam.ac.uk/dasher/
http://www.johnrausch.com/SlidingBlockPuzzles/
http://www.johnrausch.com/SlidingBlockPuzzles/rushhour/rush1.htm
http://www.kompozer.net/
http://www.kurzweilcyberart.com/KCATaaron/STAFsample
http://www.lego.com
http://www.lego.com/en-us/Default.aspx
http://www.lib.utexas.edu
http://www.literacyworks.org/mi/assessment/findyourstrengths.html
http://www.math.yorku.ca/SCS/Gallery/timelines.html
http://www.museumofhoaxes.com/hoax/
http://www.museumofhoaxes.com/index.html
http://www.museumofhoaxes.com/newsletter/nov2002.html
http://www.nu2.nu/pebuilder/
http://www.pdos.lcs.mit.edu/scigen/
http://www.printfreegraphpaper.com/
http://www.pz.harvard.edu/PIs/HG.htm
http://www.quicktopic.com/21/H/LkxmWumTbewf
http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6V0P-42JHFRS-C&_coverDate=03/31/2001&_alid=64818525&_rdoc=1&_fmt=&_orig=search&_qd=1&_cdi=5652&_sort=d&wchp=dGLbVzz-lSzBV&_acct=C000013678&_version=1&_urlVersion=0&_userid=186797&md5=76b8665eed592fe2666d64e8c2d165ce
http://www.scientificsonline.com/
http://www.sciplus.com/
http://www.sigtools.com
http://www.themediadrome.com/content/poetry/frost_two_tramps.htm
http://www.thirdvoice.com/
http://www.tinyURL.com
http://www.tomshardware.com/2005/09/09/windows_in_your_pocket/
http://www.tomshardware.com/reviews/windows-pocket,1113.html
http://www.uic.edu
http://www.uic.edu/
http://www.uic.edu/uic/
http://www.wordle.net/create
http://www.youtube.com/watch?v=LiAuyM3gB5U
http://yupnet.org/zittrain/
jakob@ubuntu:~/cs450/main/solutions/hw10$ cat broken
http://logos.cs.uic.edu/APCS/index.htm from http://logos.cs.uic.edu/reed/
http://logos.cs.uic.edu/CFX from http://logos.cs.uic.edu/reed/
http://logos.cs.uic.edu/Intro%20Prog/102Spring02/index.htm from http://logos.cs.uic.edu/reed/
http://logos.cs.uic.edu/Intro%20Prog/171%20Spring%2001/index.htm from http://logos.cs.uic.edu/reed/
http://logos.cs.uic.edu/IT101%20Fall%2006/ from http://logos.cs.uic.edu/reed/
http://logos.cs.uic.edu/IT101%20Spring%2006/ from http://logos.cs.uic.edu/reed/
http://logos.cs.uic.edu/reed/CLASSES/info.html from http://logos.cs.uic.edu/reed/
http://interact.uoregon.edu/MediaLit/FA/MLArticleFolder/bloop.html from http://logos.cs.uic.edu/reed/FUN/Fun.html
http://logos.cs.uic.edu/reed/FUN/mojopac.com from http://logos.cs.uic.edu/reed/FUN/Fun.html
http://logos.cs.uic.edu/reed/FUN/tinyurl.com/y9499k from http://logos.cs.uic.edu/reed/FUN/Fun.html
http://logos.cs.uic.edu/reed/FUN/u3.com from http://logos.cs.uic.edu/reed/FUN/Fun.html
http://logos.cs.uic.edu/reed/GerardoVideo.wmv from http://logos.cs.uic.edu/reed/
http://go.hrw.com/atlas from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/giraffian.com/kids from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/howstuffworks.com from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/macromedia.com from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/micro.magnet.fsu.edu from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/microsoft.com from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/nasa.gov from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/pbskids.org/zoom from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/CFX2/MainUI2.jsp from http://logos.cs.uic.edu/reed/PERSONAL/resume.html
http://logos.cs.uic.edu/reed/PERSONAL/scientificsonline.com from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/13SkyDiveVideo.avi from http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/index.html
http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/www.skydivecsc.com from http://logos.cs.uic.edu/reed/PERSONAL/SkyDiving/index.html
http://logos.cs.uic.edu/reed/PERSONAL/www.bionicle.com from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/www.bonus.com from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/www.exploratorium.edu from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/www.geocities.com/mrsmartens from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/www.grc.nasa.gov/WWW/K-12 from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/www.ipl.org/kidspace from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/www.jagex.com from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/www.justiceR.homestead.com from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/www.nationalgeographic.com from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/www.runescape.com from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/www.scitoys.com from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/www.shodor.org/interactivate from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/www.si.edu/kids from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/www.spacekids.com from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/reed/PERSONAL/www.squeakland.org from http://logos.cs.uic.edu/reed/PERSONAL/KidLinks.html
http://logos.cs.uic.edu/UIC%20CS%20Info%20PowerPoint/CS%20job%20slides.ppt from http://logos.cs.uic.edu/reed/
http://logos.cs.uic.edu/UIC%20CS%20Info%20PowerPoint/Intro%20UIC.ppt from http://logos.cs.uic.edu/reed/
http://logos.cs.uic.edu/UIC%20CS%20Info%20PowerPoint/JasonLeighPresentation.ppt from http://logos.cs.uic.edu/reed/
http://urbantapestries.net/ from http://logos.cs.uic.edu/reed/FUN/Fun.html
http://www.abandonkeep.com from http://logos.cs.uic.edu/reed/FUN/Fun.html
http://www.grand-illusions.com/shop.htm from http://logos.cs.uic.edu/reed/FUN/Fun.html
http://www.kurzweilcyberart.com/KCATaaron/STAFsample from http://logos.cs.uic.edu/reed/FUN/Fun.html
http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6V0P-42JHFRS-C&_coverDate=03/31/2001&_alid=64818525&_rdoc=1&_fmt=&_orig=search&_qd=1&_cdi=5652&_sort=d&wchp=dGLbVzz-lSzBV&_acct=C000013678&_version=1&_urlVersion=0&_userid=186797&md5=76b8665eed592fe2666d64e8c2d165ce from http://logos.cs.uic.edu/reed/PERSONAL/resume.html
http://www.sigtools.com from http://logos.cs.uic.edu/reed/
http://www.themediadrome.com/content/poetry/frost_two_tramps.htm from http://logos.cs.uic.edu/reed/PERSONAL/index.html
http://www.thirdvoice.com/ from http://logos.cs.uic.edu/reed/Papers/Web%20Page%20Annotator%20ICTE%20paper.htm

The rules

For this assignment, you may use either C/C++/Java or shell scripting (bash, awk/gawk, sed, tr, cat, etc). In addition, you may use curl for fetching documents from the shell, or libcurl for fetching documents from C. In C, you may use regular expressions for parsing documents, see regex.h, or 'man regex'. Using regular expressions is not mandatory, but recommended (it's an awesome tool to know). If you use Java, you may use the Java SE 6 standard libraries only.

You may not use wget instead of curl, and if you find a version of curl that does recursive document retrieval, you may not use that either. Languages other than the ones mentioned above are by request only. In general, python, perl and ruby are not allowed, nor will most other general-purpose languages.

You do not need to handle sites that have an infinite or impractically large (say a google search for "email") number of valid URLs.

curl gets unhappy with certain URLs. You will not be penalized for reporting these as broken links, even if they work in your browser.

Hints

In regards to parsing HTML with regular expressions, I found this answer to be particularly enlightening. Be sure to read the entire answer.

The following command line snippet demonstrates extracting "img src" and "a href" URLs with regular expressions on linux. On OS X, replace "sed -r" with "sed -E".

curl http://www.cs.uic.edu/ | sed 's/>/>\
/g' | sed -r -n 's/.*<(a|img)[^>]*(href|src)=["'']?([^" >]*)["'']?.*$/\3/p'

Here the 'sed' command with a newline actually adds a newline after each '>' character, to make sure there is at most one URL per line. With "curl", if a page download fails it'll give you a non-zero return code. You can check it like this:

curl http://some.strange.url
if (( $? != 0 )); then
 echo "curl returned error";
fi

In other cases, the download succeeds, but you get an HTTP error code (404 not found, for example). To see the error codes, use

curl -v http://theurl 2> /tmp/stderr.log > /tmp/thefile

this will output the HTTP header on stderr, which is then redirected to /tmp/stderr.log. In this example, stdout is also redirected, but to a different file.

Watch out for relative URLs, both in HTTP redirects and in HTML pages. The can be either host-relative (starting with /), or path relative (starting without /), and may contain both '.' and '..'. They may also start with "http:" but without the "//", as illustrated on http://rites.uic.edu

For my solution, I supply a --max-time 10 parameter to curl. Some of the URLs on my page lead to things that take more than 10 seconds to fetch, leading to an error. We won't grade the homework on any such site, but you might still be interested to try it.

How are the 12 points distributed?

You may think of this homework as one regular homework, and one bonus homework. Thus, if you get 6 points or more, you will get 6 points on the first homework, and whatever is left on the second (bonus) homework.

The grading script only produces 6 points: this is on a carefully constructed set of pages. The remaining 6 points will be awarded based on your performance on these three "external" URLs:

Grading

The grading script is at /pub/grading-scripts/hw10/. To run the grading script:

./hw10_score username score_file

The grading script used following url for testing:

http://www.cs.uic.edu/~amusa/folder1/folder2/

It assigns score by comparing your program output with solution output. The solution outputs are exported from the svn during the grading. The grading script checks for counts of visited pages, checked urls and broken urls. It also checks for corresponding urls. You need to follow the format given in the examples so that it matches with the solution format. Specially the format of the broken links should be following:

broken_link from linked_from

Topic revision: r13 - 2011-12-02 - 16:55:02 - Main.jakob
 
Copyright 2016 The Board of Trustees
of the University of Illinois.webmaster@cs.uic.edu
WISEST
Helping Women Faculty Advance
Funded by NSF