01_project_NLP_Dataset.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Generating Datasets with a Twitter API\n",
    "This Project is divided in three main Jupyter Notebooks. The first Notebook (\"01_project_NLP_Dataset\") constains the overview of the Twitter API's and how to generate a Dataset with those tools. The second and the third Notebook (\"02_project_NLP_nltk\") and (\"03_project_NLP_spacy\") represent the main part of the NLP project. In these two notebooks, NLP techniques such as tokenization, lemmatization, stop word removal and polarity classification are applied to various generated Twitter records. In addition, the results of NLP techniques are graphically displayed."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Introduction\n",
    "\n",
    "Tweepy is a Python library for accessing a Twitter API. Tweepy is used in this project for accessing the Streaming API and the Search API. Those API's enable downloading Tweets and metadata from Twitter users. \n",
    "\n",
    "#### Streaming API\n",
    "The Streaming API is generating real-time data from Twitter. You can choose from different parameters to limit your generated data. For example the location of Tweets. In this project the Streaming API was used to generate real-time Tweets from the German cities Munich, Frankfurt, Berlin and Cologne. Furthermore the data was collected over four hours. \n",
    "\n",
    "The first step after accessing the data set is to look at the data. The Tweets looked bad. There are lot of different languages, lot of colloquial language and lot of useless not related information. After a hours of trying to clean the data, it turned out that you can get no usefull information out of this data set. Therefore there will be no further analysis in this approach. Nevertheless the generated dataset is aviable. Maybe NLP tasks can be done on a larger dataset, but then a much bigger dataset has to be generated over days.\n",
    "\n",
    "#### Search API\n",
    "Twitter provides with the Search API the possibility to collect up to 3200 Tweets from one user. Against the background to generate a useful NLP data set, three famous Twitter personalities were selected. Donald Trump, Hillary Clinton and Bernie Sanders have an active Twitter account and are, because of the Presidential election in the United States in 2016, related to each other. These properties are very useful for analyzing and comparing Tweets against the background of NLP.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "##### Important to know\n",
    "While using the Twitter API's, there is a individual key required. This key will be send by E-Mail from Twitter and is for personal usage only. This key is hidden in the following code example. If someone want to run this code, to generate the data set, then a separate key must be used. But there is no use to run this code, because all of the generated data is provided in the Project folder."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Search API\n",
    "- access to a data set that already exists from tweets that have occurred\n",
    "- max. the last 3.200 tweets\n",
    "- 180 request in 15 min period"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "## Connect with your Twitter Development App\n",
    "\n",
    "### Twitter API ###\n",
    "import tweepy\n",
    "import twitter\n",
    "\n",
    "api = twitter.Api(consumer_key='insert_key_here',\n",
    "                  consumer_secret='insert_key_here',\n",
    "                  access_token_key='insert_key_here',\n",
    "                  access_token_secret='insert_key_here')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "#### Function for collecting Data with specific usernames ####\n",
    "\n",
    "#number of tweets (remember: max.3200 tweets per user)\n",
    "\n",
    "#define username\n",
    "trump = \"@realDonaldTrump\"\n",
    "clinton = \"@HillaryClinton\"\n",
    "sanders = \"@BernieSanders\"\n",
    "\n",
    "### uncomment for starting generating Dataset (takes long time)\n",
    "#username = trump\n",
    "###\n",
    "\n",
    "## \n",
    "import csv\n",
    "import sys\n",
    "import tweepy\n",
    "import numpy as np\n",
    "import pandas as pd\n",
    "##\n",
    "\n",
    "# Set up\n",
    "auth = tweepy.OAuthHandler('insert_key_here', \n",
    "                                'insert_key_here')# consumer_key, consumer_secret\n",
    "auth.set_access_token('insert_key_here',\n",
    "                          'insert_key_here') # access_key, access_key_secret\n",
    "# Calling Search API via library tweepy\n",
    "api = tweepy.API(auth)\n",
    "\n",
    "#function for runtime error (only 180 tweets per 15 min)\n",
    "def limit_handled(cursor):\n",
    "    while True:\n",
    "        try:\n",
    "            try:\n",
    "                yield cursor.next()\n",
    "            except StopIteration:\n",
    "                return\n",
    "        except tweepy.RateLimitError:\n",
    "            time.sleep(15 * 60)\n",
    "            \n",
    "#define what objects should be stored \n",
    "\n",
    "df = []\n",
    "for tweet in limit_handled(tweepy.Cursor(api.user_timeline, screen_name=username, count=5000).items()):\n",
    "    df.append([username, tweet.id_str, tweet.source, tweet.created_at,\n",
    "               tweet.retweet_count, tweet.favorite_count, tweet.text.encode('utf-8')])\n",
    "    \n",
    "# write all in csv file / in df\n",
    "filename= username + \"_tweets.csv\"\n",
    "with open(filename, \"w+\") as file:\n",
    "    writer = csv.writer(file, delimiter=',')\n",
    "    writer.writerow(['User', 'Tweet_ID', 'Source', 'Created_at', 'Retweet_count', 'Favorite_count', 'Text'])\n",
    "    writer.writerows(df)\n",
    "    "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Take a look at the generatet Dataset"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>User</th>\n",
       "      <th>Tweet_ID</th>\n",
       "      <th>Source</th>\n",
       "      <th>Created_at</th>\n",
       "      <th>Retweet_count</th>\n",
       "      <th>Favorite_count</th>\n",
       "      <th>Text</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138445389709885445</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-11 13:58:26</td>\n",
       "      <td>3622</td>\n",
       "      <td>14775</td>\n",
       "      <td>b'\\xe2\\x80\\x9cWhy did the Democrats run if the...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138444530020245505</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-11 13:55:01</td>\n",
       "      <td>3892</td>\n",
       "      <td>16524</td>\n",
       "      <td>b'Good day in the Stock Market. People have no...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138434259637690375</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-11 13:14:13</td>\n",
       "      <td>4542</td>\n",
       "      <td>18706</td>\n",
       "      <td>b'....If Mexico produces (which I think they w...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138433774327410688</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-11 13:12:17</td>\n",
       "      <td>4247</td>\n",
       "      <td>18157</td>\n",
       "      <td>b'...Companies to come to the U.S.A and to get...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138428346214363142</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-11 12:50:43</td>\n",
       "      <td>6772</td>\n",
       "      <td>27314</td>\n",
       "      <td>b'Maria, Dagan, Steve, Stuart V - When you are...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138427450927529984</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-11 12:47:09</td>\n",
       "      <td>4149</td>\n",
       "      <td>14929</td>\n",
       "      <td>b'This is because the Euro and other currencie...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138418208803831808</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-11 12:10:26</td>\n",
       "      <td>7647</td>\n",
       "      <td>37786</td>\n",
       "      <td>b'The United States has VERY LOW INFLATION, a ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138414246298042369</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-11 11:54:41</td>\n",
       "      <td>9714</td>\n",
       "      <td>36558</td>\n",
       "      <td>b'Sad when you think about it, but Mexico righ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138413497858101249</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-11 11:51:43</td>\n",
       "      <td>10496</td>\n",
       "      <td>41680</td>\n",
       "      <td>b'PRESIDENTIAL HARASSMENT!'</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138412973649747968</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-11 11:49:38</td>\n",
       "      <td>7470</td>\n",
       "      <td>31664</td>\n",
       "      <td>b'....investigation in the Senate. They can ta...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138412971846189056</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-11 11:49:37</td>\n",
       "      <td>8350</td>\n",
       "      <td>34716</td>\n",
       "      <td>b'\\xe2\\x80\\x9cMueller has spoken. He found No ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138406809121755138</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-11 11:25:08</td>\n",
       "      <td>8934</td>\n",
       "      <td>31403</td>\n",
       "      <td>b'\\xe2\\x80\\x9cJerry Nadler\\xe2\\x80\\x99s Trump ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138404143222206464</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-11 11:14:32</td>\n",
       "      <td>8684</td>\n",
       "      <td>36491</td>\n",
       "      <td>b'New book just out, \\xe2\\x80\\x9cThe Real Deal...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138290077740740610</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-11 03:41:17</td>\n",
       "      <td>9570</td>\n",
       "      <td>33609</td>\n",
       "      <td>b'#AmericaFIRST #MAGA\\xf0\\x9f\\x87\\xba\\xf0\\x9f\\...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138270602719113216</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-11 02:23:54</td>\n",
       "      <td>10732</td>\n",
       "      <td>33673</td>\n",
       "      <td>b'https://t.co/RRcP8ZDy1e'</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138270102598684673</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-11 02:21:55</td>\n",
       "      <td>8097</td>\n",
       "      <td>28339</td>\n",
       "      <td>b'https://t.co/V8TxJ3KVLZ'</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138219548979675138</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-10 23:01:02</td>\n",
       "      <td>21502</td>\n",
       "      <td>91076</td>\n",
       "      <td>b'Despite the Phony Witch Hunt, we will contin...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138217562783830016</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-10 22:53:08</td>\n",
       "      <td>8725</td>\n",
       "      <td>43229</td>\n",
       "      <td>b'Congratulations to the 2019 Indianapolis 500...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138156921901522945</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-10 18:52:10</td>\n",
       "      <td>17106</td>\n",
       "      <td>87809</td>\n",
       "      <td>b'I have been briefed on the helicopter crash ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138148226853416962</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-10 18:17:37</td>\n",
       "      <td>20376</td>\n",
       "      <td>84806</td>\n",
       "      <td>b'Can\\xe2\\x80\\x99t believe they are bringing i...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138109362101268480</td>\n",
       "      <td>Twitter Media Studio</td>\n",
       "      <td>2019-06-10 15:43:11</td>\n",
       "      <td>13059</td>\n",
       "      <td>46286</td>\n",
       "      <td>b'Thank you @MarkLevinShow and John Eastman! h...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138107553504735233</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-10 15:36:00</td>\n",
       "      <td>12574</td>\n",
       "      <td>0</td>\n",
       "      <td>b'RT @VP: .@POTUS\\xe2\\x80\\x99 strong stand got...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138076700959498242</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-10 13:33:24</td>\n",
       "      <td>11657</td>\n",
       "      <td>42684</td>\n",
       "      <td>b'https://t.co/2O43Na2Nmr'</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138076655266816002</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-10 13:33:13</td>\n",
       "      <td>11102</td>\n",
       "      <td>41003</td>\n",
       "      <td>b'https://t.co/TwLPmiAB78'</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138040393033895936</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-10 11:09:08</td>\n",
       "      <td>21192</td>\n",
       "      <td>82874</td>\n",
       "      <td>b'When will the Failing New York Times admit t...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138030977521987584</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-10 10:31:43</td>\n",
       "      <td>16986</td>\n",
       "      <td>83401</td>\n",
       "      <td>b'....We do not anticipate a problem with the ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138030976578310144</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-10 10:31:43</td>\n",
       "      <td>21207</td>\n",
       "      <td>98762</td>\n",
       "      <td>b'We have fully signed and documented another ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138024129616142336</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-10 10:04:30</td>\n",
       "      <td>50423</td>\n",
       "      <td>0</td>\n",
       "      <td>b'RT @realDonaldTrump: Twitter should let the ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138023874141069312</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-10 10:03:29</td>\n",
       "      <td>34381</td>\n",
       "      <td>0</td>\n",
       "      <td>b'RT @realDonaldTrump: If President Obama made...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1138023680385191936</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2019-06-10 10:02:43</td>\n",
       "      <td>20468</td>\n",
       "      <td>0</td>\n",
       "      <td>b'RT @realDonaldTrump: For two years all the D...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3165</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1048693669870501889</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-06 21:57:09</td>\n",
       "      <td>34830</td>\n",
       "      <td>154635</td>\n",
       "      <td>b'The crowd in front of the U.S. Supreme Court...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3166</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1048668088059584512</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-06 20:15:30</td>\n",
       "      <td>57598</td>\n",
       "      <td>250415</td>\n",
       "      <td>b'I applaud and congratulate the U.S. Senate f...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3167</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1048665701513187328</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-06 20:06:01</td>\n",
       "      <td>25934</td>\n",
       "      <td>149345</td>\n",
       "      <td>b'I have asked Steve Daines, our great Republi...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3168</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1048606042123395072</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-06 16:08:57</td>\n",
       "      <td>27246</td>\n",
       "      <td>125885</td>\n",
       "      <td>b'Women for Kavanaugh, and many others who sup...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3169</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1048419104594558976</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-06 03:46:07</td>\n",
       "      <td>16597</td>\n",
       "      <td>0</td>\n",
       "      <td>b'RT @realDonaldTrump: Thank you Minnesota - I...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3170</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1048324424020254725</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-05 21:29:54</td>\n",
       "      <td>18565</td>\n",
       "      <td>0</td>\n",
       "      <td>b'RT @FLOTUS: Thank you Malawi! \\xf0\\x9f\\x87\\x...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3171</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1048324404856414209</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-05 21:29:49</td>\n",
       "      <td>19282</td>\n",
       "      <td>0</td>\n",
       "      <td>b'RT @FLOTUS: Thank you Ghana! \\xf0\\x9f\\x87\\xb...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3172</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1048226225196552193</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-05 14:59:41</td>\n",
       "      <td>37176</td>\n",
       "      <td>189936</td>\n",
       "      <td>b'Very proud of the U.S. Senate for voting \\xe...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3173</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1048197648807854080</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-05 13:06:08</td>\n",
       "      <td>34805</td>\n",
       "      <td>152167</td>\n",
       "      <td>b'Just out: 3.7% Unemployment is the lowest nu...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3174</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1048196883464818688</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-05 13:03:06</td>\n",
       "      <td>49169</td>\n",
       "      <td>169531</td>\n",
       "      <td>b'The very rude elevator screamers are paid pr...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3175</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1048172962094964736</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-05 11:28:02</td>\n",
       "      <td>5156</td>\n",
       "      <td>0</td>\n",
       "      <td>b'RT @newsobserver: Presidential adviser and d...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3176</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1048172372778471424</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-05 11:25:42</td>\n",
       "      <td>7473</td>\n",
       "      <td>0</td>\n",
       "      <td>b'RT @Scavino45: \\xf0\\x9f\\x9a\\xa8Happening Now...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3177</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1048015772214353921</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-05 01:03:25</td>\n",
       "      <td>14328</td>\n",
       "      <td>66886</td>\n",
       "      <td>b'Beautiful evening in Rochester, Minnesota. V...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3178</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1048012979357270017</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-05 00:52:20</td>\n",
       "      <td>16597</td>\n",
       "      <td>78823</td>\n",
       "      <td>b'Thank you Minnesota - I love you!\\nhttps://t...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3179</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1047984297607618565</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-04 22:58:21</td>\n",
       "      <td>13306</td>\n",
       "      <td>57448</td>\n",
       "      <td>b'Just made my second stop in Minnesota for a ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3180</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1047974091318149120</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-04 22:17:48</td>\n",
       "      <td>15977</td>\n",
       "      <td>67586</td>\n",
       "      <td>b'Congressman Bishop is doing a GREAT job! He ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3181</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1047931723302887424</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-04 19:29:27</td>\n",
       "      <td>11860</td>\n",
       "      <td>50141</td>\n",
       "      <td>b'\\xe2\\x80\\x9cU.S. Stocks Widen Global Lead\\xe...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3182</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1047928708172894208</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-04 19:17:28</td>\n",
       "      <td>10130</td>\n",
       "      <td>38262</td>\n",
       "      <td>b'Statement on National Strategy for Counterte...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3183</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1047903710389534720</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-04 17:38:08</td>\n",
       "      <td>20250</td>\n",
       "      <td>90944</td>\n",
       "      <td>b'Working hard, thank you! https://t.co/6HQVaE...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3184</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1047853098365079553</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-04 14:17:01</td>\n",
       "      <td>28302</td>\n",
       "      <td>116672</td>\n",
       "      <td>b'This is now the 7th. time the FBI has invest...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3185</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1047849122672390146</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-04 14:01:13</td>\n",
       "      <td>15679</td>\n",
       "      <td>0</td>\n",
       "      <td>b'RT @ChatByCC: While armed with the power of ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3186</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1047847548600377344</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-04 13:54:58</td>\n",
       "      <td>26071</td>\n",
       "      <td>109341</td>\n",
       "      <td>b'This is a very important time in our country...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3187</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1047842341246173185</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-04 13:34:16</td>\n",
       "      <td>21616</td>\n",
       "      <td>128792</td>\n",
       "      <td>b'Our country\\xe2\\x80\\x99s great First Lady, M...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3188</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1047822816580722690</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-04 12:16:41</td>\n",
       "      <td>31869</td>\n",
       "      <td>132837</td>\n",
       "      <td>b'The harsh and unfair treatment of Judge Bret...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3189</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1047673458241560576</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-04 02:23:11</td>\n",
       "      <td>34974</td>\n",
       "      <td>149989</td>\n",
       "      <td>b'Wow, such enthusiasm and energy for Judge Br...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3190</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1047637712004636673</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-04 00:01:09</td>\n",
       "      <td>19383</td>\n",
       "      <td>81393</td>\n",
       "      <td>b'My thoughts and prayers are with the Florenc...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3191</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1047495435760427008</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-03 14:35:48</td>\n",
       "      <td>13163</td>\n",
       "      <td>67513</td>\n",
       "      <td>b'Just spoke to President-Elect Andres Manuel ...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3192</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1047493831426498561</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-03 14:29:25</td>\n",
       "      <td>24618</td>\n",
       "      <td>98811</td>\n",
       "      <td>b'I see it each time I go out to Rallies in or...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3193</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1047489875614883841</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-03 14:13:42</td>\n",
       "      <td>13426</td>\n",
       "      <td>66363</td>\n",
       "      <td>b'Mexico, Canada and the United States are a g...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3194</th>\n",
       "      <td>@realDonaldTrump</td>\n",
       "      <td>1047487803746074624</td>\n",
       "      <td>Twitter for iPhone</td>\n",
       "      <td>2018-10-03 14:05:28</td>\n",
       "      <td>12243</td>\n",
       "      <td>59595</td>\n",
       "      <td>b'Blowout numbers on New Jobs and, separately,...</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>3195 rows × 7 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                  User             Tweet_ID                Source  \\\n",
       "0     @realDonaldTrump  1138445389709885445    Twitter for iPhone   \n",
       "1     @realDonaldTrump  1138444530020245505    Twitter for iPhone   \n",
       "2     @realDonaldTrump  1138434259637690375    Twitter for iPhone   \n",
       "3     @realDonaldTrump  1138433774327410688    Twitter for iPhone   \n",
       "4     @realDonaldTrump  1138428346214363142    Twitter for iPhone   \n",
       "5     @realDonaldTrump  1138427450927529984    Twitter for iPhone   \n",
       "6     @realDonaldTrump  1138418208803831808    Twitter for iPhone   \n",
       "7     @realDonaldTrump  1138414246298042369    Twitter for iPhone   \n",
       "8     @realDonaldTrump  1138413497858101249    Twitter for iPhone   \n",
       "9     @realDonaldTrump  1138412973649747968    Twitter for iPhone   \n",
       "10    @realDonaldTrump  1138412971846189056    Twitter for iPhone   \n",
       "11    @realDonaldTrump  1138406809121755138    Twitter for iPhone   \n",
       "12    @realDonaldTrump  1138404143222206464    Twitter for iPhone   \n",
       "13    @realDonaldTrump  1138290077740740610    Twitter for iPhone   \n",
       "14    @realDonaldTrump  1138270602719113216    Twitter for iPhone   \n",
       "15    @realDonaldTrump  1138270102598684673    Twitter for iPhone   \n",
       "16    @realDonaldTrump  1138219548979675138    Twitter for iPhone   \n",
       "17    @realDonaldTrump  1138217562783830016    Twitter for iPhone   \n",
       "18    @realDonaldTrump  1138156921901522945    Twitter for iPhone   \n",
       "19    @realDonaldTrump  1138148226853416962    Twitter for iPhone   \n",
       "20    @realDonaldTrump  1138109362101268480  Twitter Media Studio   \n",
       "21    @realDonaldTrump  1138107553504735233    Twitter for iPhone   \n",
       "22    @realDonaldTrump  1138076700959498242    Twitter for iPhone   \n",
       "23    @realDonaldTrump  1138076655266816002    Twitter for iPhone   \n",
       "24    @realDonaldTrump  1138040393033895936    Twitter for iPhone   \n",
       "25    @realDonaldTrump  1138030977521987584    Twitter for iPhone   \n",
       "26    @realDonaldTrump  1138030976578310144    Twitter for iPhone   \n",
       "27    @realDonaldTrump  1138024129616142336    Twitter for iPhone   \n",
       "28    @realDonaldTrump  1138023874141069312    Twitter for iPhone   \n",
       "29    @realDonaldTrump  1138023680385191936    Twitter for iPhone   \n",
       "...                ...                  ...                   ...   \n",
       "3165  @realDonaldTrump  1048693669870501889    Twitter for iPhone   \n",
       "3166  @realDonaldTrump  1048668088059584512    Twitter for iPhone   \n",
       "3167  @realDonaldTrump  1048665701513187328    Twitter for iPhone   \n",
       "3168  @realDonaldTrump  1048606042123395072    Twitter for iPhone   \n",
       "3169  @realDonaldTrump  1048419104594558976    Twitter for iPhone   \n",
       "3170  @realDonaldTrump  1048324424020254725    Twitter for iPhone   \n",
       "3171  @realDonaldTrump  1048324404856414209    Twitter for iPhone   \n",
       "3172  @realDonaldTrump  1048226225196552193    Twitter for iPhone   \n",
       "3173  @realDonaldTrump  1048197648807854080    Twitter for iPhone   \n",
       "3174  @realDonaldTrump  1048196883464818688    Twitter for iPhone   \n",
       "3175  @realDonaldTrump  1048172962094964736    Twitter for iPhone   \n",
       "3176  @realDonaldTrump  1048172372778471424    Twitter for iPhone   \n",
       "3177  @realDonaldTrump  1048015772214353921    Twitter for iPhone   \n",
       "3178  @realDonaldTrump  1048012979357270017    Twitter for iPhone   \n",
       "3179  @realDonaldTrump  1047984297607618565    Twitter for iPhone   \n",
       "3180  @realDonaldTrump  1047974091318149120    Twitter for iPhone   \n",
       "3181  @realDonaldTrump  1047931723302887424    Twitter for iPhone   \n",
       "3182  @realDonaldTrump  1047928708172894208    Twitter for iPhone   \n",
       "3183  @realDonaldTrump  1047903710389534720    Twitter for iPhone   \n",
       "3184  @realDonaldTrump  1047853098365079553    Twitter for iPhone   \n",
       "3185  @realDonaldTrump  1047849122672390146    Twitter for iPhone   \n",
       "3186  @realDonaldTrump  1047847548600377344    Twitter for iPhone   \n",
       "3187  @realDonaldTrump  1047842341246173185    Twitter for iPhone   \n",
       "3188  @realDonaldTrump  1047822816580722690    Twitter for iPhone   \n",
       "3189  @realDonaldTrump  1047673458241560576    Twitter for iPhone   \n",
       "3190  @realDonaldTrump  1047637712004636673    Twitter for iPhone   \n",
       "3191  @realDonaldTrump  1047495435760427008    Twitter for iPhone   \n",
       "3192  @realDonaldTrump  1047493831426498561    Twitter for iPhone   \n",
       "3193  @realDonaldTrump  1047489875614883841    Twitter for iPhone   \n",
       "3194  @realDonaldTrump  1047487803746074624    Twitter for iPhone   \n",
       "\n",
       "               Created_at  Retweet_count  Favorite_count  \\\n",
       "0     2019-06-11 13:58:26           3622           14775   \n",
       "1     2019-06-11 13:55:01           3892           16524   \n",
       "2     2019-06-11 13:14:13           4542           18706   \n",
       "3     2019-06-11 13:12:17           4247           18157   \n",
       "4     2019-06-11 12:50:43           6772           27314   \n",
       "5     2019-06-11 12:47:09           4149           14929   \n",
       "6     2019-06-11 12:10:26           7647           37786   \n",
       "7     2019-06-11 11:54:41           9714           36558   \n",
       "8     2019-06-11 11:51:43          10496           41680   \n",
       "9     2019-06-11 11:49:38           7470           31664   \n",
       "10    2019-06-11 11:49:37           8350           34716   \n",
       "11    2019-06-11 11:25:08           8934           31403   \n",
       "12    2019-06-11 11:14:32           8684           36491   \n",
       "13    2019-06-11 03:41:17           9570           33609   \n",
       "14    2019-06-11 02:23:54          10732           33673   \n",
       "15    2019-06-11 02:21:55           8097           28339   \n",
       "16    2019-06-10 23:01:02          21502           91076   \n",
       "17    2019-06-10 22:53:08           8725           43229   \n",
       "18    2019-06-10 18:52:10          17106           87809   \n",
       "19    2019-06-10 18:17:37          20376           84806   \n",
       "20    2019-06-10 15:43:11          13059           46286   \n",
       "21    2019-06-10 15:36:00          12574               0   \n",
       "22    2019-06-10 13:33:24          11657           42684   \n",
       "23    2019-06-10 13:33:13          11102           41003   \n",
       "24    2019-06-10 11:09:08          21192           82874   \n",
       "25    2019-06-10 10:31:43          16986           83401   \n",
       "26    2019-06-10 10:31:43          21207           98762   \n",
       "27    2019-06-10 10:04:30          50423               0   \n",
       "28    2019-06-10 10:03:29          34381               0   \n",
       "29    2019-06-10 10:02:43          20468               0   \n",
       "...                   ...            ...             ...   \n",
       "3165  2018-10-06 21:57:09          34830          154635   \n",
       "3166  2018-10-06 20:15:30          57598          250415   \n",
       "3167  2018-10-06 20:06:01          25934          149345   \n",
       "3168  2018-10-06 16:08:57          27246          125885   \n",
       "3169  2018-10-06 03:46:07          16597               0   \n",
       "3170  2018-10-05 21:29:54          18565               0   \n",
       "3171  2018-10-05 21:29:49          19282               0   \n",
       "3172  2018-10-05 14:59:41          37176          189936   \n",
       "3173  2018-10-05 13:06:08          34805          152167   \n",
       "3174  2018-10-05 13:03:06          49169          169531   \n",
       "3175  2018-10-05 11:28:02           5156               0   \n",
       "3176  2018-10-05 11:25:42           7473               0   \n",
       "3177  2018-10-05 01:03:25          14328           66886   \n",
       "3178  2018-10-05 00:52:20          16597           78823   \n",
       "3179  2018-10-04 22:58:21          13306           57448   \n",
       "3180  2018-10-04 22:17:48          15977           67586   \n",
       "3181  2018-10-04 19:29:27          11860           50141   \n",
       "3182  2018-10-04 19:17:28          10130           38262   \n",
       "3183  2018-10-04 17:38:08          20250           90944   \n",
       "3184  2018-10-04 14:17:01          28302          116672   \n",
       "3185  2018-10-04 14:01:13          15679               0   \n",
       "3186  2018-10-04 13:54:58          26071          109341   \n",
       "3187  2018-10-04 13:34:16          21616          128792   \n",
       "3188  2018-10-04 12:16:41          31869          132837   \n",
       "3189  2018-10-04 02:23:11          34974          149989   \n",
       "3190  2018-10-04 00:01:09          19383           81393   \n",
       "3191  2018-10-03 14:35:48          13163           67513   \n",
       "3192  2018-10-03 14:29:25          24618           98811   \n",
       "3193  2018-10-03 14:13:42          13426           66363   \n",
       "3194  2018-10-03 14:05:28          12243           59595   \n",
       "\n",
       "                                                   Text  \n",
       "0     b'\\xe2\\x80\\x9cWhy did the Democrats run if the...  \n",
       "1     b'Good day in the Stock Market. People have no...  \n",
       "2     b'....If Mexico produces (which I think they w...  \n",
       "3     b'...Companies to come to the U.S.A and to get...  \n",
       "4     b'Maria, Dagan, Steve, Stuart V - When you are...  \n",
       "5     b'This is because the Euro and other currencie...  \n",
       "6     b'The United States has VERY LOW INFLATION, a ...  \n",
       "7     b'Sad when you think about it, but Mexico righ...  \n",
       "8                           b'PRESIDENTIAL HARASSMENT!'  \n",
       "9     b'....investigation in the Senate. They can ta...  \n",
       "10    b'\\xe2\\x80\\x9cMueller has spoken. He found No ...  \n",
       "11    b'\\xe2\\x80\\x9cJerry Nadler\\xe2\\x80\\x99s Trump ...  \n",
       "12    b'New book just out, \\xe2\\x80\\x9cThe Real Deal...  \n",
       "13    b'#AmericaFIRST #MAGA\\xf0\\x9f\\x87\\xba\\xf0\\x9f\\...  \n",
       "14                           b'https://t.co/RRcP8ZDy1e'  \n",
       "15                           b'https://t.co/V8TxJ3KVLZ'  \n",
       "16    b'Despite the Phony Witch Hunt, we will contin...  \n",
       "17    b'Congratulations to the 2019 Indianapolis 500...  \n",
       "18    b'I have been briefed on the helicopter crash ...  \n",
       "19    b'Can\\xe2\\x80\\x99t believe they are bringing i...  \n",
       "20    b'Thank you @MarkLevinShow and John Eastman! h...  \n",
       "21    b'RT @VP: .@POTUS\\xe2\\x80\\x99 strong stand got...  \n",
       "22                           b'https://t.co/2O43Na2Nmr'  \n",
       "23                           b'https://t.co/TwLPmiAB78'  \n",
       "24    b'When will the Failing New York Times admit t...  \n",
       "25    b'....We do not anticipate a problem with the ...  \n",
       "26    b'We have fully signed and documented another ...  \n",
       "27    b'RT @realDonaldTrump: Twitter should let the ...  \n",
       "28    b'RT @realDonaldTrump: If President Obama made...  \n",
       "29    b'RT @realDonaldTrump: For two years all the D...  \n",
       "...                                                 ...  \n",
       "3165  b'The crowd in front of the U.S. Supreme Court...  \n",
       "3166  b'I applaud and congratulate the U.S. Senate f...  \n",
       "3167  b'I have asked Steve Daines, our great Republi...  \n",
       "3168  b'Women for Kavanaugh, and many others who sup...  \n",
       "3169  b'RT @realDonaldTrump: Thank you Minnesota - I...  \n",
       "3170  b'RT @FLOTUS: Thank you Malawi! \\xf0\\x9f\\x87\\x...  \n",
       "3171  b'RT @FLOTUS: Thank you Ghana! \\xf0\\x9f\\x87\\xb...  \n",
       "3172  b'Very proud of the U.S. Senate for voting \\xe...  \n",
       "3173  b'Just out: 3.7% Unemployment is the lowest nu...  \n",
       "3174  b'The very rude elevator screamers are paid pr...  \n",
       "3175  b'RT @newsobserver: Presidential adviser and d...  \n",
       "3176  b'RT @Scavino45: \\xf0\\x9f\\x9a\\xa8Happening Now...  \n",
       "3177  b'Beautiful evening in Rochester, Minnesota. V...  \n",
       "3178  b'Thank you Minnesota - I love you!\\nhttps://t...  \n",
       "3179  b'Just made my second stop in Minnesota for a ...  \n",
       "3180  b'Congressman Bishop is doing a GREAT job! He ...  \n",
       "3181  b'\\xe2\\x80\\x9cU.S. Stocks Widen Global Lead\\xe...  \n",
       "3182  b'Statement on National Strategy for Counterte...  \n",
       "3183  b'Working hard, thank you! https://t.co/6HQVaE...  \n",
       "3184  b'This is now the 7th. time the FBI has invest...  \n",
       "3185  b'RT @ChatByCC: While armed with the power of ...  \n",
       "3186  b'This is a very important time in our country...  \n",
       "3187  b'Our country\\xe2\\x80\\x99s great First Lady, M...  \n",
       "3188  b'The harsh and unfair treatment of Judge Bret...  \n",
       "3189  b'Wow, such enthusiasm and energy for Judge Br...  \n",
       "3190  b'My thoughts and prayers are with the Florenc...  \n",
       "3191  b'Just spoke to President-Elect Andres Manuel ...  \n",
       "3192  b'I see it each time I go out to Rallies in or...  \n",
       "3193  b'Mexico, Canada and the United States are a g...  \n",
       "3194  b'Blowout numbers on New Jobs and, separately,...  \n",
       "\n",
       "[3195 rows x 7 columns]"
      ]
     },
     "execution_count": 1,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#Trump\n",
    "import pandas as pd\n",
    "\n",
    "df_trump = pd.read_csv('@realDonaldTrump_tweets.csv')\n",
    "df_trump"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "#Clinton\n",
    "import pandas as pd\n",
    "\n",
    "df_clinton = pd.read_csv('@HillaryClinton_tweets.csv')\n",
    "df_clinton"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "#Sanders\n",
    "import pandas as pd\n",
    "\n",
    "df_sanders = pd.read_csv('@BernieSanders_tweets.csv')\n",
    "df_sanders"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Main task - NLP\n",
    "\n",
    "These three generated Twitter datasets are in the two following Jupyter Notebooks used. The datas are analysed by two different popular NLP packages **NLTK** and **Spacy**. The goal by using two different packages is to have a benchmark possibility. Furthermore the outcome of those two packages, i.e. the cleaned data will be **visualized** and in addition analysed against the background of **sentiment analysis**."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Link to [Notebook 2 - NLTK](02_project_NLP_nltk.ipynb)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Link to [Notebook 3 - Spacy](03_project_NLP_spacy.ipynb)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Credits:\n",
    "https://developer.twitter.com/en/docs.html\n",
    "\n",
    "https://spacy.io\n",
    "\n",
    "https://www.nltk.org\n",
    "\n",
    "https://textblob.readthedocs.io/en/dev/\n",
    "\n",
    "https://github.com/cjhutto/vaderSentiment"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.8"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}