MrCarlito-0.1This page contains information about the MrCarlito-0.1 Spider.MrCarlito-0.1 is an experimental spider that collects header & link information from web pages. The spider is written in PERL (Practical Extraction and Report Language), and uses the LWP::UserAgent Class. Currently this spider does not delve into websites, it simply obtains the headers & hostnames contained in your web page index. Questions & concerns can be directed to the author via email: smashcarlito@gmail.com IP Addresses associated with this spider:
User Agent:
Example of information obtained: Url: http://featuredcars.com Status: 200 OK Server: Apache/1.3.37 (Unix) PHP/5.2.3 Content-Length: Last-Modified: Content-Type: text/html, text/html; charset=utf-8 Client-Peer: 64.237.40.81:80 X-Powered-By: PHP/5.2.3 Title: Featured Cars - Sell My Car X-Meta-Description: List & sell your car online for free. X-Meta-Keywords: sell car online, sell for free, free classified car listing, featured cars, cars, car for sale, sell my car ------------------ Links: http://www.w3.org http://www.featuredcars.com http://dealers.featuredcars.com http://pagead2.googlesyndication.com http://www.idrivethis.com http://www.jeepfriendfinder.com http://www.getsatellitetvtoday.com http://www.featuredre.com http://www.reliableservers.com http://www.google-analytics.com Project Goal: To collect & organize data for future search purposes. |