Quantcast
Channel: ScrapeBox Forum - All Forums
Viewing all 5962 articles
Browse latest View live

Proxy Speed & SB crashing

$
0
0
Hey,
i´m scraping emails from domain lists at around 100k per 5 min. 
Any idea how much faster it will be with proxies? Do 10 proxies mean 10x speed?


Also for some reason SC seems to crash/become nonrespondant after a while..
i think it might have to do with a browser doing parallel work.. can that be or
are there other issues?

Banned proxies

$
0
0
Hi,

I purchased 10 private proxies and ran the harvester.
No special operators in the keywords. Just regular ones.
I even set a delay of 60 seconds in between keywords.
But proxies got banned after returning results for just 20 keywords!

Got 10 more proxies and did the same test but increased delay for 90 seconds. Still proxies got banned after returning results for only 58 keywords.

That is really low performance.

Any clues of what could be happening?

Thanks

Email scraping large site

$
0
0
So i´m trying to email scrape this large site and am getting to my limits.
I´m using a 18k seedlist of URLS and the grab emails from URL list but
SB kept crashing and i lost the harvested emails. Now i´m trying with
just 10 connections ( no proxies) yet and it takes ages.

As loopline mentioned i probably need proxies.
Now the questions is how many do i need?

The site in question has 20 million pages indexed.
If is crawler going through URLS at X per hour/minute second rate
can i assume that if i use more proxies /connections i can simply multiply
the number by the number of proxies? 

It´s been an hour now and it went through roughly 70k urls
can i assume/extrapolate to reach 20 mio. pages in 285 hours more

or less ? Or is it not that simple?


Please help ..i feel stupid

Associating URL to keyword

$
0
0
I have a very large keyword list that i´m using for a site:domain.com search to find profiles. (It´s name, emails or other identifying data)

I need to associate each harvested URL with the keyword(s) to find the corresponding profile.


So far i see no way to attach meta information to the URL´s harvested. It that correct?


(I understand that i could use the URLs and then extract the EMAILS + attach the URLS on the export)

Error - 1 Vanity Addon Checker

$
0
0
Hello, what exactly means error - 1 ?

Automator not passing details to file..

$
0
0
I've set up the automated proxy scraper and it's running fine, however despite SB saying that there are 30 proxies that have passed G the file I set up only has 1 proxy listed. I checked the file settings in the automator and it is correct

Followed the excellent videos but i can think what i might have done wrong

Any Clues

Consolidating Custom Data

$
0
0
Ok, so i´m using the custom data grabber to get different sets of data from
a set of profiles but i also want to grab the emails. As far as i understand it 
i cannot use the CDG to grab emails.  What would be the best way or process
 to get both data sets.

Ideally i want to create profiles of people with name, follower count, social media data plus their
email contact data scraped from one or multiple URLs.
 
My approach would be the following
1. use an email crawler that adds url information
2. take the custom data grabber and run those urls
3. somehow consolidate the information using excel or the help of a coder.


Ideally i´d like take custom data grabs from different sites and augment those searches in one database though.
Because in most cases emails are a scarce ressource on one plattform i´d like to search for it on multiple platforms.

My approach for this would be:

1.grab links by crawling a domain/site that has a relatively large amount of the the contacts i´m looking for.
2. use custom data grabber to find name & data like follower count for relevance segmentation.
3. use an email crawler to grab those urls
4.  use the name as search term in a search for "site:otherdomain.com" to get more information/emails from other domains.

please advise if there is an easier process for this or if im overthinking stuff again.


Also when i´m exporting why can´t there be a way to just export ONE URL with all the custom fields instead of having the custom fields repeating all the time?

Offer : 35% Off With Canada VPS Hosting On Annual Billing Cycle - Prewebhost.com!

$
0
0
35% OFF for Next 24 Hours. Order any Canada VPS Hosting plan and Get 35% OFF. Valid for next 24 Hours Only.


Hurry UP and get the Big Discount with PREWEBHOST.COM :
 
Coupon Code : G4IYC67MPT

Cheap Canada VPS : https://www.prewebhost.com/cheap-canada-...sting.html

Note : Make sure to choose annual billing cycle while placing order.

Hurry Up!

=============
Regards,

Ilona Jackson,
https://www.prewebhost.com
PrewebHost Hosting Solutions.
In Business Since 2010.

WP/Joomla Hosting - $1 Web Hosting - Single Click Installation - Prewebhost.com!

$
0
0
If you are trying to manage a CMS-based website via WordPress or Joomla, you are going to need effective the best hosting services possible. At Prewebhost.com, we provide a wealth of WordPress hosting themes and ecommerce website hosting to make your CMS woes go away immediately. We know the importance of having a fast and reliable WordPress database host, and with our fine collection of WordPress VIP hosting systems you have all the chances in the world to make the website really stand out and benefit your business for years to come.


If you need to utilize professional and safe hosting of an open source content management system then we can help you do just that with a stream of professional services that are designed to give you the right standard of service at all times. We make sure that your CMS is running safely and smoothly, and that you are able to push forward with your business and really make an impact on the market. With our servers, you are guaranteed quality performance without the expense of having to pay over the top for our help. Instead, we make our monthly web hosting service as feature heavy as possible so that whatever it is that you need to do or add to your website, we will be able to help you out.

Also we are offering 30 Days money back guarantee with our web hosting services and everything that you could possibly need to promote your website through budget web hosting can happen with Prewebhost hosting services, you simply need to get in touch and we can take the process forward from there! So hurry up and signup today.

Features :

- Unlimited Web Space
- Unlimited Bandwidth
- Single Click Script Installer
- Money Back Guarantee
- 99.9% Uptime Guarantee
- 24x7 Live Chat Support
- Easy Upgrade Facility
- Multiple GEO IP Locations Available
- Custom Plan Available
- Free Migration Service
- Unlimited Email Account
- Latest PHP 7.0+
- Max PHP Memory
- Allow_URL_Fopen Having On Status
- Custom PHP.INI available
- Legal Porn Contents Allowed
- Unlimited FTP Accounts
- Softacolous Script Library
- Unlimited Addon Domains Plan Available
- Unlimited Mysql Databases Plan Available
- Free SEO Tools
- Free SSL Available
- On Demand Website Security Audit Available
- Free Virus Scanner
- DMCA Suspension Warnings
- Assistance For Spamming
- Unlimited Subdomains
- Daily Incremental Backups

#Prewebhost.com-WordpressHosting-Cheapresellerhosting-$1unlimitedhosting-onedollarhosting-moneybackhosting-freemigraitonhosting

https://www.prewebhost.com/order-now.html

=============
Regards,

http://www.prewebhost.com
PrewebHost Hosting Solutions.
In Business Since 2010.

WRAITH PROJECT CREATOR (Create GSA SER Projects with 1 click!)

$
0
0
ONE click GSA Search Engine Ranker project creator.•Automatic article scraper AND spinner.

•  Automatic PDF creation.
•  Automatic field translations for Polish & German fields.
•  Yandex API support for translations (FREE: https://tech.yandex.com/translate/).
•  Spinning done via The Best Spinner (PAID: http://thebestspinner.com/) - More alternatives coming soon.
•  Export directly into GSA Search Engine Ranker's project folder ready to use.
•  2 licenses for 2 servers.
•  And more...
•  FREE updates for life.

[Image: wpc-01.png]
More info: http://www.wraithseo.com/wraith-project-creator.php

Regards

Graham

hi, we are selling proxy service.

$
0
0
Good day to all guys here!

We are proxy seller, mainly doing huge amount proxy which including socks4, socks5 and http proxy.

If anybody need us, please send a PM to get more information.

SocksHub.net-400,000+ Private Rotating Proxies for managing and scaling your projects

$
0
0
SocksHub.net  site welcomes you to this forum and wishes you success in your various projects. 

SocksHub.net was originally created as a project capable of scaling any network activity for major companies from different industries. 

Scaling is the company’s main objective, which has remained unchanged for years. It is the main slogan of those who strive for great results. On our part, we are capable of providing you with the perfect tool to achieve these results. SocksHub.net has reached maximum proxy capacity, which has been increasing profits for our clients successfully. 


The Benefits you'll get:
- Huge online proxies
- Maximum speed (higher than anyone ever)
- Suitable for any activity
- 1-hour free test
- All ports are opened
- Huge choices of tariffs
- Unlimited traffic
- Support Socks4/5,and HTTP
- 24/7/365 technical support 
- Total anonymity
- BackConnect (speed still remains maximum) 


| We can’t disclose the size of our online capacity for it is a commercial secret. We can only say that our proxy just to good to beyond your imagination. 

| Our allocation system is designed such that you get a static txt file. There is a pool behind this file, which independently rotates and substitutes good proxies with bad ones. So you need not fear that you will have a huge number of errors due to delays in updating the file or that part of the file will be dead. 

| We have a huge number of pools that we control and distribute according to user needs so that nobody would interfere with anybody and that everyone would feel comfortable when using our service. 



Price:
Mix:  .............. 30,000-35,000 online per day, $100 per week, $400 per month. 
Double Mix:  . 60,000-80,000 online per day, $160 per week, $550 per month. 
USA:  ................. 2,000-4,000 online per day, $150 per week, $600 per month. 
Europe:  ............ 4,000-6,000 online per day, $150 per week, $600 per month. 
Russia:  ............. 4,000-6,000 online per day, $150 per week, $600 per month. 
Exclusive:  ...............25,000    online per day, $800 per week, $2500 per month. 

*Excplusive pool - this pool gives you 100% guarantee that no one except you would use the proxies allocated. You get maximum speed, unlimited thread, customized approach, personal tech support. These features would help allocate proxies running smoothly with your software. This is the right pool for Google, Yahoo, Yandex, etc.
*At the moment we have 13 standard pools, No repetitions, only private, high-speed proxies


Payment Methods:
<> BitCoin
<> PayPal
<> Epayments
<> WebMoney


Our contact details:
Skype:   live:SocksHub.net
Jabber:   support@sockshub.net
E-Mail:    support@sockshub.net
Telegram:  @SocksHub
Icq:        711758324



| This is just a small part of what we can offer. For more information, please contact our Support team or visit our website at: http://SocksHub.net

scraped url count

$
0
0
hi

i scraped over 30 millions urls from various search engines - once the scrape is complete you are shown a summery screen that shows you how many urls were scraped from the varius engines for the given keywords - - After I clicked the exit button then all of the urls are moved to the scrapebox harvester screen - for some reason its only showing 9 million urls and not the 30 million i I scraped


does scrapebox automatically delete duplicate urls when they come into the harvester or is there another reason for this ?

Prewebhost.com-$1Web Hosting, Cheap Reseller, Managed Dedicated Servers, 20% Discount

$
0
0
Prewebhost.com is managed cPanel Hosting provider with 99.9% Network Uptime and 24/7 Technical support. Prewebhost offers unlimited disk space/bandwidth and 1 domain hosting in just $1 per month. Also current promotion will help you to get the 20% discount as well on any hosting plan. Signing up Prewebhost.com will give you multiple advantages single click script installation, quality chat support, SEO tools and much more.

Shared Hosting Coupon Code : PREWEB20

Cheap Reseller Hosting Services is also the main service of Prewebhost.com. We have got thousands of resellers who are reselling our services without any hassle, we are providing the private DNS with our reseller plan that makes clients easy to setup their own business in hosting industry. Also server never fails and always gives best uptime ever which clients expecting from the web host. Resellers can get any type of help from our live chat agents and through support systems.

Cheaper Reseller Hosting Services Coupon Code : PREWEBR35

Prewebhost.com Dealing with VPS hosting services too and available with different locations, we guarantee that we will make you feel proud on your decision as our services are unique and having quality support 24x7.

Managed Dedicated Servers: Discounts can be varied as per the plan, so kindly contact our sales dept for the current discounts

Prewebhost hosting solutions offers best yet cheap deals on Intel and AMD dedicated servers. Our Fully Managed Dedicated Servers includes 24x7 monitoring, initial server Security, Tweaking and Hardening, free Server Migrations and restoration from your old host along with 24x7 live chat as well as ticket support by our highly trained engineers.

Our all server includes fast & free setup, month to month term, no contract to sign, multiples locations, wide variety of operating systems, control panels, 390Gbps backbone, 5 free IPs for 10Mbit, up to 10 free IPs for 100Mbit or faster packages.

Available in : Los Angeles, CA – Seattle, WA – Paris, FR – Chicago,IL – New York, NY – Miami, FL – London, GB – Amsterdam, NL – Frankfurt, DE – Vienna, AT – Prague, CZ

Connectivity : 1Gbps – 10Gbps – 2x10Gbps Unmetered servers connectivity

Features of Prewebhost.com :

- Instant Activations of orders
- Instant Product Detail Delivery
- 24x7x365 Days Live Chat Support
- Latest Versions and Hardware Config's
- Award Wining Support Quality

Please visit Prewebhost.com to know complete list of features included in our hosting plans. In case of any queries, you can email us at sales at sales@prewebhost.com or contact our 24x7 Online Chat representative through our website.

https://www.prewebhost.com/order-now.html

Prewebhost.com : $1 web hosting | Cheap Reseller Hosting | $1 unlimited hosting | Managed Dedicated Servers | Cheap Netherlands VPS | Cheaper Reseller Web Hosting

Prewebhost Hosting Solutions.
In Business Since 2010.

check a list of URL to see if they contain a backlink to my site

$
0
0
Ive got a list of URLs that i want to check if they contains backlinks to my site. 

Whats the best tool / addon to do this ? 

I was looking at the free link checker tool, but i wondered if there was anything better in the paid version, plus i want to use proxies which i beleive is only available in the paid version

What is this: "Failed general/unknown"?

$
0
0
Hi,
When using contact from poster, I'm getting this error: Failed general/unknown.

 Although the form is submitted successfully.

This also happens when I'm trying to train new platforms.

Prewebhost.com : PHP 7.0 | $1 Web Hosting | Free Auto SSL!

$
0
0
As you all aware that non-ssl websites are now considered as "Not Secured" websites and its making huge issue with the website SEO and it results also its too costly to get SSL for the startup websites, hence Prewebhost.com is now offering Free Auto SSL with our Linux Shared and Reseller hosting services and this SSL will improve the presence on website's in world wide web.


We have also upgraded our php and mysql versions and offering latest versions along with the multiple php option, this is the advanced feature which can help clients with the featured third party scripts installations. Along with this...our services comes with affordable and cheaper prices starting from $1 per month...all our shared and reseller hosting plans comes with amazing features like free website migration, unlimited space, unlimited bandwidth, free ssl, cheap dedicated Ip's, max mails per hour, latest php versions and much more.

We are also offering low cost Private SSL's for the clients who wish to have own private SSL for their websites and our prices are comparatively low and affordable for everyone, so start/switch today with our innovative services and allow us the chance to serve you with.

Features: Fast, Cheap, SLA Backed 99.9% Uptime Guarantee. Stable non-oversold, Linux & Windows Environments.

- Unlimited Space
- Unlimited Bandwidth
- Free Auto SSL
- Single Click Script Installer
- Free Migration Service
- Free Domain Registration
- Multiple Php Options i.e. 5.4, 5.5, 7.0, 7.1 etc
- SEO Tools
- Huge Discounts
- Custom Hosting Plans
- 5 Year Hosting Plans
- Easy Billing Cycles
- Custom Private Nameservers
- 24x7 Live Chat Support
- Max Mails Per Hour
- Max Memory Limit

#Prewebhost.com : $1 Unlimited Hosting | One Dollar Hosting | Cheap Reseller Hosting | Low Cost Hosting | Free Migration Service

Order Now : https://www.prewebhost.com/

Regards,
Sales Team

delphi regex

$
0
0
Hi,
i had some regex´s created for use with scrapebox by a freelancer (In Delphi)
He said they´re working but when i tested them with SB they did not.
They´re for scraping Facebook page titles/names and like counts

fb like
([\d,]+) people like this

fb page name
<meta[^>]+property="og:title"[^>]+content="([^"]+)"

https://www.facebook.com/barackobama/ so basically Barack Obama and 54mio likes.


Any ideas?

meta scraper

$
0
0
I´m trying to scrape thousands of meta descriptions. My storm proxy 40 threads seems not to be able to handle it.
I get alot of Failed: Connection timed out
Am i doing something wrong or is the number of threads too low?

Vanity Name Checker Debug Mode

$
0
0
Hi,

how can i debug the Vanity Name Checker addon? I checked the box "Enable Debug Mode", but nothing happend - nothing is logged anywhere.

Addon Version 2.1.0.16
Scrapebox 2.0.0.88

I'm trying to figure out why the Checker does not recognize a certain pattern.

Thank you
Viewing all 5962 articles
Browse latest View live