+ 1

Would you help me about google search result scraping?? How can i get all tags in body with python??

I am trying to take google search results. I used beautifulsoup and requests libraries before for scraping on other web sites successfully. But on google, i didn't take tags in body so i didn't reach searc results titles. Please help me.

19th Dec 2019, 8:01 PM
kenan yıldırım
kenan yıldırım - avatar
7 Réponses
0
kenan yıldırım in order to do web scraping, you should be able to read html code, at least the basics. Also, you must take a look at the google source code of web results, you don't just predict what the tag name or class name will be. So simple answer, if you want web scraping, learn to read html.
19th Dec 2019, 8:05 PM
Aymane Boukrouh
Aymane Boukrouh - avatar
0
I know html. I wrote a few web sites before. Have you ever try to scrape google search results??? If you can, could you send me your codes please?
19th Dec 2019, 8:43 PM
kenan yıldırım
kenan yıldırım - avatar
0
kenan yıldırım no I have not, but I'll try once I have free time, it shouldn't be hard tho, you can watch youtube tutorials, I'm sure there will be results
19th Dec 2019, 9:12 PM
Aymane Boukrouh
Aymane Boukrouh - avatar
0
I watched all tutorials. You can sure. If you have free time period and if you can do, please show it to me.
20th Dec 2019, 11:41 AM
kenan yıldırım
kenan yıldırım - avatar
0
kenan yıldırım sure I'll try later, but first can you show me your attempt ? From what I just saw in the source code, the titles's class is LC20lb, so that's what you want to be looking for. I can send you a very simple script that show you the titles using requests_html module, but I'll only help if you show me a progress, otherwise it would be just a copy-paste, and you won't be learning.
20th Dec 2019, 2:50 PM
Aymane Boukrouh
Aymane Boukrouh - avatar
0
Could u write me your email??
21st Dec 2019, 11:39 AM
kenan yıldırım
kenan yıldırım - avatar
0
kenan yıldırım there is no need for an email, I don't even check it. Everything can be be sent in here.
21st Dec 2019, 3:24 PM
Aymane Boukrouh
Aymane Boukrouh - avatar