A surname - income relationship algorithm

Question

Hey, what I attempted to do was the following:

1. Take the Finnish surname and the number of people who have it , from www.tuomas.salste.net/suku/nimi/index-lista.html

2. Add the surnames one by one to www.is.fi/verotiedot search bar on the site
3. Count number of people the is verotiedot site shows
4. Divide this number with the number of people who have that surname

I tried with Python but was unable to construct a full algorithm. Any ideas?

Answer 1

BeautifulSoup (bs4) module will help you gather data for websites.

However, interacting with websites, you may need to use the Selenium module. You can also use it to gather data.

If possible stick to bs4, interact via URLs for the search bar (with requests module) if you can. But if you can't, you should build the entire thing with Selenium.