Auto Crawl Websites in SQL Database

[virtua46]

Hi,

I'm creating a very basic Search Engine, but i would like they crawl automatically Websites in my SQL Database (obviously with some rules, in this case only top-sites), how i can make this happening? (If you would i can share the access of the Database with you for help)

Thanks for help!

 

[leafypiggy]

That would be a violation of our terms of service.

 

[virtua46]

Oh, sorry, now i know i don't try to make... (i will never known that this can be a type of violation)

 

[caftpx10]

https://www.x10hosting.com/legal/terms-of-service/
"We do not allow any type of application, bot, or script that runs continuousl or unattended." (I see a typo.)
Crawling is basically using a bot. The rule here is very self-explanatory. Making it run automatically is an unattended and possibly a continuous task which is a no-no.