Django website loading for 10 mins.How to improve performance?

Question

I built a django project that uses my search and scrape youtube search results and display in my page in cards. I scraped video id,title,description,thumbnail image,channel name but it takes more time to load.Is there a way to improve the performance of my django project?I have used BeautifulSoup to scrape the data.

If anyone interested in helping me, if he/she wants i will explain the question further.
Looking forward for your helps.

Thank you in advance🙏

Answer 1

There is a faster way: YouTube API.
https://developers.google.com/youtube/v3/docs/search/list

Answer 2

After i added the web scraping part, i am facing such issue

Answer 3

Can you share the code, GitHub, or something?

Answer 4

What changes did you make after which such a issue arises?

Answer 5

Is your code making too many requests? Is the internet speed slow?
I have faced those issues in the past with BeautifulSoup.

Answer 6

Yes it would scrape the details of upto 20 videos in a loop. Is that more? Should i reduce?

Answer 7

With these you can narrow the search and then scrape for thumbnails.

Answer 8

Thank you so much Amey Bhavsar

Answer 9

I have completed my project and uploaded.
Url:https://myutube3000.herokuapp.com

Open this website with desktop version in the chrome menu