How can I create a Big Data Application

Question

I want to create a Big Data Application that tracks the prices of goods over time. What resources do I need to have, which platform do I use. What and where do I need to study

Answer 1

I've seen developers build webscraping applications that scrape prices from websites like eBay or Amazon. This can be done using Python libraries like BeautifulSoup. You can setup a script to do this periodically and save the values to a database for analysis or visualization. Search SQL Alchemy for details on working with Python and databases. A common place to deploy Python apps is Heroku.