Is it possible to pass a value (e.g. $row['id']) into RollingCurl so that it's available for use within the callback function?

foreach ($rows as $row) {
// Add each request to the RollingCurl object.
$request = new RollingCurlRequest($row['url']);
$rc->add($request);
}

(Basically, it's the MySQL primary key for each row ($row['id']) that I'm trying to pass and make available within the callback function.)

Thanks.

I haven't tried reusing the connections, or at least I don't remember experimenting with that. Would be interesting to see if you can make that work. If you do, please post your results here so others can gain from them.

Thanks!

I'm using your nice piece of code for a lot of data (3.5 million requests).
My rolling window is 10.
But after a while my working machine is out of memory.

I'm trying to find the memory leak and I noticed you don't close the single curl handles.
I think, after
curl_multi_remove_handle($master, $done['handle']);
you have to call
curl_close($done['handle']);
to totally close the handle, because
curl_multi_close($master);
closes the master but not the single handles.

And can you explain me, why you have to "// start a new request" if you just startet all of the requests in the "for" loop?

// make sure the rolling window isn't greater than the # of urls
$rolling_window = 5;
$rolling_window = (sizeof($urls) < $rolling_window) ? sizeof($urls) : $rolling_window;

$master = curl_multi_init();
$curl_arr = array();

// add additional curl options here
$std_options = array(CURLOPT_RETURNTRANSFER => true,
CURLOPT_FOLLOWLOCATION => true,
CURLOPT_MAXREDIRS => 5);
$options = ($custom_options) ? ($std_options + $custom_options) : $std_options;

// start the first batch of requests
for ($i = 0; $i < $rolling_window; $i++) {
$ch = curl_init();
$options[CURLOPT_URL] = $urls[$i];
curl_setopt_array($ch,$options);
curl_multi_add_handle($master, $ch);
}

do {
while(($execrun = curl_multi_exec($master, $running)) == CURLM_CALL_MULTI_PERFORM);
if($execrun != CURLM_OK)
break;
// a request was just completed — find out which one
while($done = curl_multi_info_read($master)) {
$info = curl_getinfo($done['handle']);
if ($info['http_code'] == 200) {
$output = curl_multi_getcontent($done['handle']);

// request successful. process output using the callback function.
$callback($output);

// start a new request (it's important to do this before removing the old one)
$ch = curl_init();
$options[CURLOPT_URL] = $urls[$i++]; // increment i
curl_setopt_array($ch,$options);
curl_multi_add_handle($master, $ch);

// remove the curl handle that just completed
curl_multi_remove_handle($master, $done['handle']);
} else {
// request failed. add error handling.
}
}
} while ($running);

curl_multi_close($master);
return true;
}
?>
how to solve it??? thanks

function callback($result) {
global $maindir;
…
}

eg:
$imgs = array("http://l.yimg.com/a/i/us/pim/dclient/cg504_5/img/md5/509840ceb0dd52f5f024dba77099b4b0_1.gif",
"http://www.onlineaspect.com/wp-content/themes/onlineaspect/images/lego.png&quot ;

save to
$maindir = "images";
$dirs = array ($maindir ."/yahoo", $maindir ."/onlineaspect");

i dont kow how to pass var dir to callback to save each images to directoy
thanks for any example