I want scrape Web contents for my website, so what to use? And any ideas where to start

Question

If I want scrape a links and titles from a blog what code should I use , as of now I'm interested in php scraping or curl

Answer 1

try "beautifulsoup"
https://pypi.python.org/pypi/beautifulsoup4

Answer 2

you need to run the script serverside and store the result of your scaping in a file that could be accessed to update content in sections of your website.
If you are using an online hosting service, pyton functinality may be limited.
If your server is on your pc you have no limits.

Answer 3

To run a python script from a webpage you can call the script with an html form the same way you'd call a php script.
search python CGI (common gateway interface) for more details on making your script executable, telling the server where to find the python interpreter and so on. This is a good starting point
https://wiki.python.org/moin/CgiScripts

Answer 4

Thank you Seamiki, Yes I tried bs4 on my pc but how to use it on my website, I can extract to CSV or json locally how to use and show on my website

Answer 5

Thank you lot dear will give try running local server or cgi, and once again thank you, got an idea now