History: Link checker

^ 2023-05: Analysis moved to ((All-in-one crawl-scrape-parse tool)) ^

Original wish: {wish id=526}

! Wishes
* Check internal and external links, and broken images and scripts
** Should be easier now that we have tiki-route.php via ((URL Rewriting Revamp))
* Check the content of the page for a keyword, to make sure it's not an error page or domain expired page
* Logs errors in a database/table
** __Ranking of most requested (and broken) resources__
*** [http://piwik.org/faq/how-to/#faq_60|How to track error pages (404 pages) in Piwik? Which URLs are 404 and which referers lead to these pages?]
* Table can be watched
* Run by
** The back-end (ex.: with search indexing script)
** Run by the visitors via jQuery
* Be smart about detecting smart errors (when it gives you a nice error page with a search engine, it's still a broken link)
* Advise you of "301 Moved Permanently" so you can update your links

! Related features
* ((Monitoring))
* ((Scraper))
* ((Accessibility)) (check if HTML/JS is valid)

! Related links
* ((tw:Uptime))
* https://moodle.org/plugins/tool_crawler
* https://packagist.org/packages/wikimedia/deadlinkchecker
* http://framework.zend.com/manual/1.11/en/zend.uri.chapter.html
* http://sourceforge.net/projects/phpspider/
* http://code.google.com/p/phpspider/
* http://www.phpkode.com/scripts/category/php-link-checking/
* http://code.google.com/p/sitecheckr/source/browse/trunk/%20sitecheckr%20--username%20superpeon1/test_link_utility.php
* http://www.scriptol.com/scripts/link-checker.php (PHP/GPL)
* http://www.opensourcescripts.com/info/linkchecker.html (Python)
* http://wordpress.org/extend/plugins/broken-link-checker/
* http://drupal.org/project/linkchecker
* http://www.linklint.org/
* https://github.com/ocodia/Check-My-Links/
* https://github.com/wet-boew/wet-boew-wpss

! Services
* http://blog.online-domain-tools.com/2014/07/31/comparative-test-of-free-broken-link-checkers/