Reddit Stock Analysis using AWS Cloud

Description

Finding out about stocks before they make the news using Reddit Data , Nasdaq Data & Cloud Analytics Services from Amazon Web Services.

Lately, a group of online traders collaborated on Reddit & took down the hedge fund by bidding up the stock price of GameStop.This unprecedented move by the online traders took the market by storm with continuous ups and downs in the stock value. Therefore, we decided to come up with a project that can analyze the discussions on Reddit for “/r/WallStreetBets” and gives the users an idea about what are some of the stocks that are being discussed, sentiment of their discussion and further allowing the user to view the additional details about the required stock over an interactive dashboard.

Environment

• AWS Cloud Envionment , Python

Tasks performed:

• Reddit Data Collection using open REST API
• Event Driven Data Pipeline
• Conversational User Interface
• Natural Language Processing
• Data Analysis

• Interactive Dashboard Visualization

• AWS Stack
  • Amazon Lex : Chatbot user interface to easy access.
    
  • AWS Lambda : Lambda Triggers to collect data from Reddit upon specific Lex Intent.
    
  • Amazon S3 : Storage of the Output files [reddit scrapped data & nasdaq stock data]
    
  • AWS Glue & AWS Athena : Athena Table for the Nasdaq Stocks Data.
    
  • Amazon Comprehend : Text Analytics [Detect Entities & Detect Sentiment]
    
  • Amazon QuickSight : Interactive dashboard allowing users to visualize the stock data attributes.
    

Architecture

Dashboard

WebPage View

• Benefits
  
  • Chatbot easy interaction, no need to read the reddit discussions.
    
  • We analyse the redditors posts and do all the heavy lifting.
    
  • Provides an interactive dashboard where the user can visualize the stock attributes.
    
• Assumptions
  
  • Redditors on the channel “/WallStreetBets” discuss only about stocks and option trading.
    
  • As fast-growing stocks are listed on Nasdaq, we have considered Nasdaq stocks data.