iMacros Script Questions
hey!
I have 1000+ URLs that I want to scrape to retrieve the title info from. After trying different things, I ultimately used iMacros scripts, which I don't know anything about. Nonetheless, I managed to make a script after reading guides.
My script is working perfectly but has few problem and have some queries
My Script:
what i want to ask is this
1- do i have to use SET !TIMEOUT_STEP 1, SET !ERRORIGNORE YES, SET !EXTRACT_TEST_POPUP NO for every URL or using these cmds on top only once will do? and save location of grabbed data needs to be at the end of every url or only at the end of the config?
2- even with SET !EXTRACT_TEST_POPUP NO i get this error once http://i.imgur.com/8UP9uMD.jpg in the begining, how to remove that??
3- out of many URLs i have a few that are dead so imacros wait till 60s before going to next url.. how to cut down the time to 10s for dead or non responding URLs?
http://i.imgur.com/FGIXElq.jpg <-- how to make it 10s limit
4- the script i made is for 1 url. now how can i multiple this script 1000+ times all with different urls that i have in a specific txt file. so either it makes this same script for all the urls or it auto leeches urls from a txt file while leeching like when first url is leeched it finds the next url from url txt file and auto inserts into this script so it can run all my urls and at the end i have results of all my urls
5- the final result i get is
how can i change is "," after URL to a tab or a double space so my results look something like this
kindly reply to all my queries and if possible redo my script so i would know where to put which code
thanks!
I have 1000+ URLs that I want to scrape to retrieve the title info from. After trying different things, I ultimately used iMacros scripts, which I don't know anything about. Nonetheless, I managed to make a script after reading guides.
My script is working perfectly but has few problem and have some queries
My Script:
Code:
VERSION BUILD=9002379 TAB T=1 TAB CLOSEALLOTHERS SET !TIMEOUT_STEP 1 SET !ERRORIGNORE YES SET !EXTRACT_TEST_POPUP NO URL GOTO=http://google.com/ ADD !EXTRACT true TAG POS=1 TYPE=TITLE ATTR=* EXTRACT=TXT SAVEAS TYPE=EXTRACT FOLDER=d:/ FILE=links.txt WAIT SECONDS=1 SET !TIMEOUT_STEP 1 SET !ERRORIGNORE YES SET !EXTRACT_TEST_POPUP NO URL GOTO=http://example.com:8087/ ADD !EXTRACT true TAG POS=1 TYPE=TITLE ATTR=* EXTRACT=TXT SAVEAS TYPE=EXTRACT FOLDER=d:/ FILE=links.txt
1- do i have to use SET !TIMEOUT_STEP 1, SET !ERRORIGNORE YES, SET !EXTRACT_TEST_POPUP NO for every URL or using these cmds on top only once will do? and save location of grabbed data needs to be at the end of every url or only at the end of the config?
2- even with SET !EXTRACT_TEST_POPUP NO i get this error once http://i.imgur.com/8UP9uMD.jpg in the begining, how to remove that??
3- out of many URLs i have a few that are dead so imacros wait till 60s before going to next url.. how to cut down the time to 10s for dead or non responding URLs?
http://i.imgur.com/FGIXElq.jpg <-- how to make it 10s limit
4- the script i made is for 1 url. now how can i multiple this script 1000+ times all with different urls that i have in a specific txt file. so either it makes this same script for all the urls or it auto leeches urls from a txt file while leeching like when first url is leeched it finds the next url from url txt file and auto inserts into this script so it can run all my urls and at the end i have results of all my urls
5- the final result i get is
Code:
http://google.com,Google
Code:
http://google.com Google
thanks!