yum install php-devel
Yum is simply the best.

Without losing my patience, I tried reading the error logs of httpd(usually in /var/log/httpd/error_log) and somewhere it showed this message,

PHP Warning:  PHP Startup: Unable to load dynamic library ‘./memcache.so’ – ./memcache.so: cannot open shared object file: No such file or directory in Unknown on line 0

After that, I tried to check the php.ini (usually in /usr/local/lib/php.ini) and made sure that the extension=memcache.so was there, and on the extension_dir property, it looked like this,

extension_dir=”./”

seeing that, I tried a lucky guess and I changed it to a full path instead,

extension_dir = “/usr/local/lib/”

Next, I simply restarted httpd with,

service httpd restart

Then I again checked the httpd error_log and I noticed that the error is gone! With that information, I immediately tried the test PHP code again and Voila! My memcache extension is running perfectly!

Hope this helps.

JM Aliling

<?php

$target = “http://joemarie-aliling.com/category/php-programming/”;
$ch = curl_init();
curl_setopt($ch, CURLOPT_URL, $target);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1);
curl_setopt($ch, CURLOPT_FOLLOWLOCATION, 1);
curl_setopt($ch, CURLOPT_AUTOREFERER, 1);
curl_setopt($ch, CURLOPT_USERAGENT, “Firefox (WindowsXP) – Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.8.1.6)  Gecko/20070725 Firefox/2.0.0.6″);           //pretend that we are a browser..
$page = curl_exec($ch);
$dom = new DOMDocument();
@$dom->loadHTML($page);       //@ suppresses any errors..
$xpath = new DOMXPath($dom);
$hrefs = $xpath->evaluate(“/html/body//a”);        // evaluate everything inside the html and body tags and extract the anchor tag. Read this
for ($i = 0; $i < $hrefs->length; $i++) {
$href = $hrefs->item($i);
$url = $href->getAttribute(‘href’);
if($url[0] == “/” || $url[0] == “#”) $url = $target . $url;  // this is to correct relative URLs and page anchors. try to remove this line and        see the effect.
echo $url . “<br>”;
}

?>

There you have it! Hope this helps with your screen scraping projects.

-JM

Let me share this wonderful PHP snippet to you. Its function is to take the base domain of a given url. For example,

say,

$url =  http://www.joemarie-aliling.com/php-programming-tutorial.php

the return value is a string =   joemarie-aliling.com

Also this works even if the URL has a subdomain, like http://subdomain.joemarie-aliling.com/php-coding-tips.php

I’ve tested this on PHP 5.2.5, but I believe, it would work with older versions of PHP.

This is a GNU Licensed, so you may use it freely.
function get_base_domain($url){
$debug = 0;
$base_domain = ”;

// generic tlds (source: http://en.wikipedia.org/wiki/Generic_top-level_domain)
$G_TLD = array(
‘biz’,'com’,'edu’,'gov’,'info’,'int’,'mil’,'name’,'net’,'org’,
‘aero’,'asia’,'cat’,'coop’,'jobs’,'mobi’,'museum’,'pro’,'tel’,'travel’,
‘arpa’,'root’,
‘berlin’,'bzh’,'cym’,'gal’,'geo’,'kid’,'kids’,'lat’,'mail’,'nyc’,'post’,’sco’,'web’,'xxx’,
‘nato’,
‘example’,'invalid’,'localhost’,'test’,
‘bitnet’,'csnet’,'ip’,'local’,'onion’,'uucp’,
‘co’ // note: not technically, but used in things like co.uk
);

// country tlds (source: http://en.wikipedia.org/wiki/Country_code_top-level_domain)
$C_TLD = array(
// active
‘ac’,'ad’,'ae’,'af’,'ag’,'ai’,'al’,'am’,'an’,'ao’,'aq’,'ar’,'as’,'at’,'au’,'aw’,'ax’,'az’,
‘ba’,'bb’,'bd’,'be’,'bf’,'bg’,'bh’,'bi’,'bj’,'bm’,'bn’,'bo’,'br’,'bs’,'bt’,'bw’,'by’,'bz’,
‘ca’,'cc’,'cd’,'cf’,'cg’,'ch’,'ci’,'ck’,'cl’,'cm’,'cn’,'co’,'cr’,'cu’,'cv’,'cx’,'cy’,'cz’,
‘de’,'dj’,'dk’,'dm’,'do’,'dz’,'ec’,'ee’,'eg’,'er’,'es’,'et’,'eu’,'fi’,'fj’,'fk’,'fm’,'fo’,
‘fr’,'ga’,'gd’,'ge’,'gf’,'gg’,'gh’,'gi’,'gl’,'gm’,'gn’,'gp’,'gq’,'gr’,'gs’,'gt’,'gu’,'gw’,
‘gy’,'hk’,'hm’,'hn’,'hr’,'ht’,'hu’,'id’,'ie’,'il’,'im’,'in’,'io’,'iq’,'ir’,'is’,'it’,'je’,
‘jm’,'jo’,'jp’,'ke’,'kg’,'kh’,'ki’,'km’,'kn’,'kr’,'kw’,'ky’,'kz’,'la’,'lb’,'lc’,'li’,'lk’,
‘lr’,'ls’,'lt’,'lu’,'lv’,'ly’,'ma’,'mc’,'md’,'mg’,'mh’,'mk’,'ml’,'mm’,'mn’,'mo’,'mp’,'mq’,
‘mr’,'ms’,'mt’,'mu’,'mv’,'mw’,'mx’,'my’,'mz’,'na’,'nc’,'ne’,'nf’,'ng’,'ni’,'nl’,'no’,'np’,
‘nr’,'nu’,'nz’,'om’,'pa’,'pe’,'pf’,'pg’,'ph’,'pk’,'pl’,'pn’,'pr’,'ps’,'pt’,'pw’,'py’,'qa’,
‘re’,'ro’,'ru’,'rw’,’sa’,’sb’,’sc’,’sd’,’se’,’sg’,’sh’,’si’,’sk’,’sl’,’sm’,’sn’,’sr’,’st’,
’sv’,’sy’,’sz’,'tc’,'td’,'tf’,'tg’,'th’,'tj’,'tk’,'tl’,'tm’,'tn’,'to’,'tr’,'tt’,'tv’,'tw’,
‘tz’,'ua’,'ug’,'uk’,'us’,'uy’,'uz’,'va’,'vc’,'ve’,'vg’,'vi’,'vn’,'vu’,'wf’,'ws’,'ye’,'yu’,
‘za’,'zm’,'zw’,
// inactive
‘eh’,'kp’,'me’,'rs’,'um’,'bv’,'gb’,'pm’,’sj’,’so’,'yt’,’su’,'tp’,'bu’,'cs’,'dd’,'zr’
);

// get domain
if ( !$full_domain = get_url_domain($url) )
{
return $base_domain;
}

// now the fun

// break up domain, reverse
$DOMAIN = explode(‘.’, $full_domain);
if ( $debug ) print_r($DOMAIN);
$DOMAIN = array_reverse($DOMAIN);
if ( $debug ) print_r($DOMAIN);

// first check for ip address
if ( count($DOMAIN) == 4 && is_numeric($DOMAIN[0]) && is_numeric($DOMAIN[3]) )
{
return $full_domain;
}

// if only 2 domain parts, that must be our domain
if ( count($DOMAIN) <= 2 ) return $full_domain;

if ( in_array($DOMAIN[0], $C_TLD) && in_array($DOMAIN[1], $G_TLD) && $DOMAIN[2] != ‘www’ )
{
$full_domain = $DOMAIN[2] . ‘.’ . $DOMAIN[1] . ‘.’ . $DOMAIN[0];
}
else
{
$full_domain = $DOMAIN[1] . ‘.’ . $DOMAIN[0];;
}

// did we succeed?
return $full_domain;
}

// get domain from url

function get_url_domain($url)
{
$domain = ”;

$_URL = parse_url($url);

// sanity check
if ( empty($_URL) || empty($_URL['host']) )
{
$domain = ”;
}
else
{
$domain = $_URL['host'];
}

return $domain;
}

Sorry for not indenting this and it looks ugly. But I guarantee you it works!

-Joemarie