Would like to develop a bot to replace our current manual data search / mining tasks. Best case scenario the functionality of the bot would be as follows (example using one of the actual sites to be scraped)
Step 1: Page: http://www.footballoutsiders.com/stats/teamoff
Data listed in categories:
Team
Rec.
2ndO Wins
(Diff)
S&P+
(Percentile)
S&P+
(Margin)
Rk
Off. S&P+
Rk
Def. S&P+
Rk
ST S&P+
Rk
Prev. Wk Rk
Chg
Step 2 : Bot will search and scrape all or specific column categories.
Step 3: Script would allow bot to produce the saved data from the scrape and re-produce it using our algorithm format.
Example:
Team Name #1 (Ohio ST) / Offense S&P column data
MINUS
Team name #2 (Michigan)- – Defense S&P column data
= Category “ABC1” on reporting
We will then compile this reporting info into team vs statistics / projections.
The teams will change weekly. The data will change weekly.
The data source and location will be consistent.
I am open to any suggestions and happy to discuss in further detail