I am trying to make the custom harvester scrape only 10 urls per page because i am using advanced operators like this inurl:.edu/phpbb2 and i am trying to avoid google blocking my IP. But every time i start the harvester it scrapes 8 urls and stops.
This are screenshots from my settings:
![[Image: iir9.jpg]]()
![[Image: r45i.jpg]]()
This is google search query:
Any idea why the harvester doesn't want to scrape?
This are screenshots from my settings:
![[Image: iir9.jpg]](http://img835.imageshack.us/img835/4365/iir9.jpg)
![[Image: r45i.jpg]](http://img835.imageshack.us/img835/821/r45i.jpg)
This is google search query:
Code:
http://www.google.com/search?complete=0&output=ie&hl=en&q={KEYWORD}&num=10&start={PAGENUM}
Any idea why the harvester doesn't want to scrape?