StackExchange_Scraper

StackExchange_Scraper is a tool designed to scrape data from StackExchange and StockTwits. This project includes a Jupyter notebook for each platform, allowing you to easily gather data.

StackExchange Scraping

1. Enter your login information in request-keys.json:

   {
       "key": "your key",
       "client_id": "your client_id"
   }

2. Open and run the stackexchange.ipynb notebook in Jupyter Notebook.

StockTwits Scraping

1. Enter your login information in usrpass.txt:

   enter your email
   enter your password
   

2. Open and run the stocktwits.ipynb notebook in Jupyter Notebook.

Files

• communities.txt: List of communities to scrape.
• messages.json: JSON file to store scraped messages from StockTwits.
• request-keys.json: JSON file for StackExchange login credentials.
• requirements.txt: List of required Python packages.
• stackexchange_data.json: JSON file to store StackExchange data.
• stackexchange.ipynb: Jupyter notebook for scraping StackExchange.
• stocktwits.ipynb: Jupyter notebook for scraping StockTwits.
• usrpass.txt: Text file for StockTwits login credentials.