Auto Crawl Websites in SQL Database

virtua46

New Member
Messages
12
Reaction score
0
Points
1
Hi,

I'm creating a very basic Search Engine, but i would like they crawl automatically Websites in my SQL Database (obviously with some rules, in this case only top-sites), how i can make this happening? (If you would i can share the access of the Database with you for help)

Thanks for help! ;)
 

leafypiggy

Manager of Pens and Office Supplies
Staff member
Messages
3,819
Reaction score
163
Points
63
That would be a violation of our terms of service.
 

virtua46

New Member
Messages
12
Reaction score
0
Points
1
Oh, sorry, now i know i don't try to make... (i will never known that this can be a type of violation)
 

caftpx10

Well-Known Member
Messages
1,535
Reaction score
114
Points
63
https://www.x10hosting.com/legal/terms-of-service/
"We do not allow any type of application, bot, or script that runs continuousl or unattended." (I see a typo.)
Crawling is basically using a bot. The rule here is very self-explanatory. Making it run automatically is an unattended and possibly a continuous task which is a no-no.
 
Top