Search the Community
Showing results for tags 'slow'.
Found 2 results
-
I have a muti-threaded bot that fetches web pages through the HTTP post plugin and saves data to a SQLite database. It also works with add-list-to-list to keep track of URLs of a site, on average between 5.000-15.000 items in the list. It's not a huge program but it eventually crashes every time I run it sooner or later. When I have 2-3 threads it lasts longer, 10-20 threads and it will crash for sure. Memory is always in the 500-800MB range, it doesn't build up, goes up and down all time. CPU usage 10-15%, so computer seems fast enough. Even on 25 threads CPU increases only by about 3%, memo
-
I am not running an automated process, but rather a UI with multiple buttons - each linked to a define to be run on the page - like a button based control panel. The control panel is designed to allow me to run multiple processes on each page to scrape specific information and load the contents of the page into fields in the UI. Each button runs a different define - scraping different info - and placing it into different on-html-window fields... When I run the bot, something strange occurs - the first 5 pages - it works great. I have 3 processes that I run on each page - and for 5 pages -
