Scrape and Summarize News Articles using Python
Original post created 18-October-2020. Updated 23-October-2020.
• Ijeoma Odoko • 11 min read
This project will scrape and summarize news articles using nltk and newspaper3K python libraries.
We will try to download a summary of all the articles based on the news headlines for a particular ticker symbol in this case 'NDX' (the NASDAQ-100 index) from the Nasdaq website.
To go to the url for a specific ticker simply replace the ticker value with your ticker of choice.
!pip install nltk
!pip install newspaper3k
Requirement already satisfied: nltk in /usr/local/lib/python3.6/dist-packages (3.2.5)
Requirement already satisfied: six in /usr/local/lib/python3.6/dist-packages (from nltk) (1.15.0)
Collecting newspaper3k
Downloading https://files.pythonhosted.org/packages/d7/b9/51afecb35bb61b188a4b44868001de348a0e8134b4dfa00ffc191567c4b9/newspaper3k-0.2.8-py3-none-any.whl (211kB)
|████████████████████████████████| 215kB 6.5MB/s
Collecting tinysegmenter==0.3
Downloading https://files.pythonhosted.org/packages/17/82/86982e4b6d16e4febc79c2a1d68ee3b707e8a020c5d2bc4af8052d0f136a/tinysegmenter-0.3.tar.gz
Requirement already satisfied: nltk>=3.2.1 in /usr/local/lib/python3.6/dist-packages (from newspaper3k) (3.2.5)
Collecting tldextract>=2.0.1
Downloading https://files.pythonhosted.org/packages/5d/c3/f4e90ae5b7dd02257c3b9dfb6747aba0b8a9c788f5401700fda055e814fc/tldextract-3.0.1-py2.py3-none-any.whl (86kB)
|████████████████████████████████| 92kB 5.2MB/s
Collecting feedfinder2>=0.0.4
Downloading https://files.pythonhosted.org/packages/35/82/1251fefec3bb4b03fd966c7e7f7a41c9fc2bb00d823a34c13f847fd61406/feedfinder2-0.0.4.tar.gz
Requirement already satisfied: PyYAML>=3.11 in /usr/local/lib/python3.6/dist-packages (from newspaper3k) (3.13)
Requirement already satisfied: requests>=2.10.0 in /usr/local/lib/python3.6/dist-packages (from newspaper3k) (2.23.0)
Requirement already satisfied: Pillow>=3.3.0 in /usr/local/lib/python3.6/dist-packages (from newspaper3k) (7.0.0)
Collecting jieba3k>=0.35.1
Downloading https://files.pythonhosted.org/packages/a9/cb/2c8332bcdc14d33b0bedd18ae0a4981a069c3513e445120da3c3f23a8aaa/jieba3k-0.35.1.zip (7.4MB)
|████████████████████████████████| 7.4MB 7.1MB/s
Collecting feedparser>=5.2.1
Downloading https://files.pythonhosted.org/packages/2c/84/df6de99cba01afc82344c9cb3a79df100a00ac33396120f8aa66c72f0d84/feedparser-6.0.1-py2.py3-none-any.whl (80kB)
|████████████████████████████████| 81kB 10.7MB/s
Collecting cssselect>=0.9.2
Downloading https://files.pythonhosted.org/packages/3b/d4/3b5c17f00cce85b9a1e6f91096e1cc8e8ede2e1be8e96b87ce1ed09e92c5/cssselect-1.1.0-py2.py3-none-any.whl
Requirement already satisfied: lxml>=3.6.0 in /usr/local/lib/python3.6/dist-packages (from newspaper3k) (4.2.6)
Requirement already satisfied: python-dateutil>=2.5.3 in /usr/local/lib/python3.6/dist-packages (from newspaper3k) (2.8.1)
Requirement already satisfied: beautifulsoup4>=4.4.1 in /usr/local/lib/python3.6/dist-packages (from newspaper3k) (4.6.3)
Requirement already satisfied: six in /usr/local/lib/python3.6/dist-packages (from nltk>=3.2.1->newspaper3k) (1.15.0)
Requirement already satisfied: filelock>=3.0.8 in /usr/local/lib/python3.6/dist-packages (from tldextract>=2.0.1->newspaper3k) (3.0.12)
Collecting requests-file>=1.4
Downloading https://files.pythonhosted.org/packages/77/86/cdb5e8eaed90796aa83a6d9f75cfbd37af553c47a291cd47bc410ef9bdb2/requests_file-1.5.1-py2.py3-none-any.whl
Requirement already satisfied: idna in /usr/local/lib/python3.6/dist-packages (from tldextract>=2.0.1->newspaper3k) (2.10)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.6/dist-packages (from requests>=2.10.0->newspaper3k) (2020.6.20)
Requirement already satisfied: chardet<4,>=3.0.2 in /usr/local/lib/python3.6/dist-packages (from requests>=2.10.0->newspaper3k) (3.0.4)
Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /usr/local/lib/python3.6/dist-packages (from requests>=2.10.0->newspaper3k) (1.24.3)
Collecting sgmllib3k
Downloading https://files.pythonhosted.org/packages/9e/bd/3704a8c3e0942d711c1299ebf7b9091930adae6675d7c8f476a7ce48653c/sgmllib3k-1.0.0.tar.gz
Building wheels for collected packages: tinysegmenter, feedfinder2, jieba3k, sgmllib3k
Building wheel for tinysegmenter (setup.py) ... done
Created wheel for tinysegmenter: filename=tinysegmenter-0.3-cp36-none-any.whl size=13538 sha256=21d80e684d759950290a5522214b146594a5846d32b0ca24500b2fddca70553e
Stored in directory: /root/.cache/pip/wheels/81/2b/43/a02ede72324dd40cdd7ca53aad718c7710628e91b8b0dc0f02
Building wheel for feedfinder2 (setup.py) ... done
Created wheel for feedfinder2: filename=feedfinder2-0.0.4-cp36-none-any.whl size=3355 sha256=f080f14c61ae68c7a747068c93d0abf2acb08950d0cae3dc16a21a1857a781d1
Stored in directory: /root/.cache/pip/wheels/de/03/ca/778e3a7a627e3d98836cc890e7cb40c7575424cfd3340f40ed
Building wheel for jieba3k (setup.py) ... done
Created wheel for jieba3k: filename=jieba3k-0.35.1-cp36-none-any.whl size=7398406 sha256=a36c59aa31ede8f68ac300bf99f8eed3d23c555646fcd8d810de80648a540526
Stored in directory: /root/.cache/pip/wheels/83/15/9c/a3f1f67e7f7181170ad37d32e503c35da20627c013f438ed34
Building wheel for sgmllib3k (setup.py) ... done
Created wheel for sgmllib3k: filename=sgmllib3k-1.0.0-cp36-none-any.whl size=6067 sha256=65eb0a2526fecb90fd3c1fb03c6fb531514631316c5b46f960ac526206787c77
Stored in directory: /root/.cache/pip/wheels/f1/80/5a/444ba08a550cdd241bd9baf8bae44be750efe370adb944506a
Successfully built tinysegmenter feedfinder2 jieba3k sgmllib3k
Installing collected packages: tinysegmenter, requests-file, tldextract, feedfinder2, jieba3k, sgmllib3k, feedparser, cssselect, newspaper3k
Successfully installed cssselect-1.1.0 feedfinder2-0.0.4 feedparser-6.0.1 jieba3k-0.35.1 newspaper3k-0.2.8 requests-file-1.5.1 sgmllib3k-1.0.0 tinysegmenter-0.3 tldextract-3.0.1
import nltk
import newspaper
import datetime
import pandas as pd
ndx_news = newspaper.build('https://www.nasdaq.com/market-activity/index/ndx/news-headlines')
for article in ndx_news.articles:
print(article.url)
http://ir.nasdaq.com/Income-Statement-Trend-Summary-and-GAAP-to-Non-GAAP-Reconciliation http://ir.nasdaq.com/events/event-details/barclays-global-financial-services-conference-2020 http://ir.nasdaq.com/events/event-details/ubs-virtual-financial-services-conference-2020 https://www.nasdaq.com/videos/tradetalks%3A-what-trends-will-dominate-the-next-decade https://www.nasdaq.com/videos/can-stock-picking-ever-be-fun-again https://www.nasdaq.com/videos/tradetalks%3A-how-will-2020-impact-investment-portfolios https://www.nasdaq.com/videos/tradetalks%3A-the-toys-for-tots-campaign-for-holiday-2020 https://www.nasdaq.com/videos/tradetalks%3A-the-launch-of-jaaa-and-democratizing-access-to-clos https://www.nasdaq.com/videos/tradetalks%3A-what-paypals-cryptocurrency-means-for-growth-in-the-space https://www.nasdaq.com/videos/tradetalks%3A-how-do-franchise-businesses-properly-open-while-protecting-staff-and-customers https://www.nasdaq.com/videos/tradetalks%3A-volatility-around-elections-is-normal https://www.nasdaq.com/videos/tradetalks%3A-finding-the-best-credit-card-for-you-credit-best-practices-and-rewards-trends https://www.nasdaq.com/videos/investing-strategies%3A-crowdstrike-ceo-insights-how-to-handle-election-2020-market-volatility https://www.nasdaq.com/videos/investing-strategies%3A-long-term-investing%3A-tips-to-maximize-returns-as-you-set-and-forget https://www.nasdaq.com/videos/investing-strategies%3A-election-2020%3A-how-to-handle-your-portfolio-amid-market-moving https://www.nasdaq.com/videos/investing-strategies%3A-crowdstrike-ceo-on-security-software-leadership-work-from-anywhere https://www.nasdaq.com/videos/investing-strategies%3A-one-on-one-with-cadence-ceo-a-look-at-blank-check-ipos-analysis-of https://www.nasdaq.com/videos/investing-strategies%3A-top-stocks-to-watch%3A-cadence-ceo-on-track-record-of-innovation-growth https://www.nasdaq.com/videos/investing-strategies%3A-virgin-galactic-draftkings-nikola-whats-next-everything-you-need-to https://www.nasdaq.com/videos/investing-strategies%3A-analyzing-strength-of-large-cap-tech-stocks-in-current-bull-market https://www.nasdaq.com/videos/investing-strategies%3A-health-care-trends-to-watch-with-medical-sector-on-the-move https://www.nasdaq.com/videos/investing-strategies%3A-trader-education%3A-ibds-top-investing-rules-for-beginners https://www.nasdaq.com/videos/how-clean-is-the-fashion-industry https://www.nasdaq.com/videos/whiskey-as-a-covid-19-hedge https://www.nasdaq.com/videos/a-cyclical-move-overall-in-the-markets-is-afoot-bofas-hyzy-says https://www.nasdaq.com/videos/ignoring-science-led-to-over-200000-u.s.-deaths%3A-johns-hopkins https://www.nasdaq.com/videos/markets-undergoing-a-reality-check%3A-fidelitys-richards https://www.nasdaq.com/videos/its-getting-tougher-for-opec-to-cut-oil-output%3A-nomura https://www.nasdaq.com/news-and-insights/in-the-money-with-fidelity-investments-dan-nathan https://www.nasdaq.com/articles/iphone-12-could-be-a-tailwind-for-apples-accessories-segment-says-analyst-2020-10-23 https://www.nasdaq.com/articles/covid-19-is-driving-a-surge-in-e-commerce-ad-spending-2020-10-23 https://www.nasdaq.com/articles/the-pandemic-shopping-list%3A-dolls-detergent-and-campers-2020-10-23 https://www.nasdaq.com/articles/the-advantages-of-blockchain-over-traditional-payments-2020-10-23 https://www.nasdaq.com/articles/forget-5g%3A-this-tech-stock-trend-is-generating-even-bigger-returns-2020-10-23 https://www.nasdaq.com/articles/whats-happening-with-moderna-stock-2020-10-19 https://www.nasdaq.com/articles/3-top-5g-stocks-to-buy-right-now-2020-10-09 https://www.nasdaq.com/articles/3-high-yield-stocks-at-rock-bottom-prices-2020-10-16 https://www.nasdaq.com/articles/workhorse-stock-could-skyrocket-on-a-u.s.-postal-service-contract-2020-10-16 https://www.nasdaq.com/articles/intel-intc-3rd-quarter-earnings%3A-what-to-expect-2020-10-22 https://www.nasdaq.com/articles/microsoft-msft-1st-quarter-earnings%3A-what-to-expect-2020-10-21 https://www.nasdaq.com/articles/tesla-tsla-3rd-quarter-earnings%3A-what-to-expect-2020-10-21 https://www.nasdaq.com/articles/netflix-nflx-3rd-quarter-earnings%3A-what-to-expect-2020-10-20 https://www.nasdaq.com/articles/is-the-market-reaction-to-intels-intc-earnings-overdone-2020-10-23 https://www.nasdaq.com/articles/the-market-is-focused-on-stimulus-will-it-come-soon-or-at-all-2020-10-22 https://www.nasdaq.com/articles/the-reaction-to-netflixs-nflx-earnings%3A-deja-vu-all-over-again-2020-10-21 https://www.nasdaq.com/articles/u.s.-debt%3A-the-elephant-in-the-room-that-keeps-growing-2020-10-19 https://www.nasdaq.com/articles/daily-markets%3A-stocks-could-hinge-on-news-from-washington-on-stimulus-or-lack-thereof-2020 https://www.nasdaq.com/articles/wall-st-week-ahead-more-u.s.-companies-offer-earnings-guidance-despite-pandemic-2020-10-23 https://www.nasdaq.com/articles/why-investors-should-be-upbeat-about-exxon-mobil-2020-10-21 https://www.nasdaq.com/articles/top-stock-trades-for-thursday%3A-snap-fb-pins-pypl-2020-10-21 https://www.nasdaq.com/articles/plug-workhorse-stock-into-your-trading-portfolio-because-it-is-electric-2020-10-21 https://www.nasdaq.com/articles/how-good-is-the-surf-in-ocean-power-technologies-stock-2020-10-21 https://www.nasdaq.com/articles/bp-bp-stock-sinks-as-market-gains%3A-what-you-should-know-2020-10-23 https://www.nasdaq.com/articles/target-tgt-outpaces-stock-market-gains%3A-what-you-should-know-2020-10-23 https://www.nasdaq.com/articles/united-parcel-service-ups-stock-sinks-as-market-gains%3A-what-you-should-know-2020-10-23 https://www.nasdaq.com/articles/hanesbrands-hbi-stock-sinks-as-market-gains%3A-what-you-should-know-2020-10-23 https://www.nasdaq.com/articles/dominion-energy-d-stock-sinks-as-market-gains%3A-what-you-should-know-2020-10-23 https://www.nasdaq.com/articles/noble-midstream-partners-nblx-stock-sinks-as-market-gains%3A-what-you-should-know-2020-10-23 https://www.nasdaq.com/articles/ciena-cien-stock-sinks-as-market-gains%3A-what-you-should-know-2020-10-23 https://www.nasdaq.com/articles/enbridge-enb-stock-sinks-as-market-gains%3A-what-you-should-know-2020-10-23 https://www.nasdaq.com/articles/nasdaqs-johan-toll-wins-fintech-person-year-2018-05-16 https://www.nasdaq.com/articles/adena-friedman%3A-esg-ai-cryptocurrency-in-focus-at-davos-2019-01-21 https://www.nasdaq.com/article/invesco-qqq-celebrates-20-years-of-curating-innovation-cm1112647?utm_source=Nasdaq_LINKEDIN_COMPANY_2185074219&utm_medium=QQQ%20anniversary%20__%20%C2%A0 https://www.nasdaq.com/solutions/midpoint-extended-life-order-m-elo
for category in ndx_news.category_urls():
print(category)
https://www.nasdaq.com/market-activity/index/ndx/news-headlines https://www.nasdaq.com/mediakit https://www.nasdaq.com/GlobalIndexes https://www.nasdaq.com/TotalMarkets https://www.nasdaq.com/marketsite http://ir.nasdaq.com https://www.nasdaq.com/public-policy https://www.nasdaq.com/videos https://www.nasdaq.com https://www.nasdaq.com/symbol https://www.nasdaq.com/solutions https://portfolio.nasdaq.com https://www.nasdaq.com/trust-center https://www.nasdaq.com/ESG-Guide
ndx_article = ndx_news.articles[0]
ndx_article.download()
ndx_article.parse()
nltk.download('punkt')
ndx_article.nlp()
[nltk_data] Downloading package punkt to /root/nltk_data... [nltk_data] Unzipping tokenizers/punkt.zip.
ndx_article.summary
''
ndx_article.keywords
['nongaap', 'trend', 'income', 'gaap', 'summary', 'reconciliation', 'statement']
ndx_article.publish_date
ndx_article.authors
[]
ndx_article.title
'Income Statement Trend Summary and GAAP to Non-GAAP Reconciliation'
url = []
keywords = []
title = []
published =[]
summary = []
authors=[]
videos = []
for article in ndx_news.articles:
url.append(article.url)
article.download()
article.parse()
article.nlp()
keywords.append(article.keywords)
title.append(article.title)
published.append(article.publish_date)
summary.append(article.summary)
authors.append(article.authors)
videos.append(article.movies)
type(url)
list
len(url)
64
data = [url, title, published, authors, summary, keywords, videos] # create list of lists
df = pd.DataFrame(data).transpose() #transpose to get 7 columns instead of 62
df.columns=['url', 'title', 'published', 'authors', 'summary', 'keywords', 'videos'] # name the columns
df
| url | title | published | authors | summary | keywords | videos | |
|---|---|---|---|---|---|---|---|
| 0 | http://ir.nasdaq.com/Income-Statement-Trend-Su... | Income Statement Trend Summary and GAAP to Non... | NaT | [] | [nongaap, trend, income, gaap, summary, reconc... | [] | |
| 1 | http://ir.nasdaq.com/events/event-details/barc... | Barclays Global Financial Services Conference ... | NaT | [] | [financial, services, barclays, 2020, global, ... | [] | |
| 2 | http://ir.nasdaq.com/events/event-details/ubs-... | UBS Virtual Financial Services Conference 2020 | NaT | [] | [financial, services, ubs, virtual, 2020, conf... | [] | |
| 3 | https://www.nasdaq.com/videos/tradetalks%3A-wh... | #TradeTalks: What Trends Will Dominate the Nex... | NaT | [] | Caleb Silver from Investopedia returns to #Tra... | [investopedia, silver, decade, tradetalks, ret... | [] |
| 4 | https://www.nasdaq.com/videos/can-stock-pickin... | Can Stock Picking Ever be Fun Again? | NaT | [] | Michael Holland, Holland & Co. founder, talks ... | [picking, surveillance, strategy, stock, bloom... | [] |
| ... | ... | ... | ... | ... | ... | ... | ... |
| 59 | https://www.nasdaq.com/articles/enbridge-enb-s... | Enbridge (ENB) Stock Sinks As Market Gains: Wh... | 2020-10-23 | [Zacks Equity Research] | In the latest trading session, Enbridge (ENB) ... | [sinks, enbridge, ratio, enb, stock, estimate,... | [] |
| 60 | https://www.nasdaq.com/articles/nasdaqs-johan-... | Nasdaq's Johan Toll Wins FinTech Person of the... | 2018-05-16 | [] | Johan Toll, head of Blockchain Product Managem... | [markets, johan, financial, nasdaq, toll, trad... | [] |
| 61 | https://www.nasdaq.com/articles/adena-friedman... | Adena Friedman: ESG, AI, Cryptocurrency In Foc... | 2019-01-21 | [] | The world economy is growing more slowly than ... | [focus, markets, public, economic, nasdaq, com... | [] |
| 62 | https://www.nasdaq.com/article/invesco-qqq-cel... | Invesco QQQ Celebrates 20 Years of Curating In... | NaT | [] | Invesco recognizes leading ETF’s long-standing... | [funds, dec, growth, 20, invesco, 2018, rank, ... | [] |
| 63 | https://www.nasdaq.com/solutions/midpoint-exte... | Midpoint Extended Life Order (M-ELO) | NaT | [] | See M-ELO in action and learn moreNasdaq's EVP... | [public, extended, structure, life, services, ... | [] |
64 rows × 7 columns
print(df.loc[0,'summary'])
for i in df.columns:
print(df.loc[3, i])
https://www.nasdaq.com/videos/tradetalks%3A-what-trends-will-dominate-the-next-decade #TradeTalks: What Trends Will Dominate the Next Decade? NaT [] Caleb Silver from Investopedia returns to #TradeTalks! He and Jill Malandrino go over what trends will dominate in the next decade. ['investopedia', 'silver', 'decade', 'tradetalks', 'returns', 'dominate', 'trends', 'malandrino', 'jill', 'caleb'] []
df.info()
<class 'pandas.core.frame.DataFrame'> RangeIndex: 64 entries, 0 to 63 Data columns (total 7 columns): # Column Non-Null Count Dtype --- ------ -------------- ----- 0 url 64 non-null object 1 title 64 non-null object 2 published 32 non-null datetime64[ns] 3 authors 64 non-null object 4 summary 64 non-null object 5 keywords 64 non-null object 6 videos 64 non-null object dtypes: datetime64[ns](1), object(6) memory usage: 3.6+ KB
df['published'].unique()
array([ 'NaT', '2020-10-23T00:00:00.000000000',
'2020-10-19T00:00:00.000000000', '2020-10-09T00:00:00.000000000',
'2020-10-16T00:00:00.000000000', '2020-10-22T00:00:00.000000000',
'2020-10-21T00:00:00.000000000', '2020-10-20T00:00:00.000000000',
'2018-05-16T00:00:00.000000000', '2019-01-21T00:00:00.000000000'],
dtype='datetime64[ns]')
df_null = df[df['published'].isnull()]
df_null['url']
0 http://ir.nasdaq.com/Income-Statement-Trend-Su... 1 http://ir.nasdaq.com/events/event-details/barc... 2 http://ir.nasdaq.com/events/event-details/ubs-... 3 https://www.nasdaq.com/videos/tradetalks%3A-wh... 4 https://www.nasdaq.com/videos/can-stock-pickin... 5 https://www.nasdaq.com/videos/tradetalks%3A-ho... 6 https://www.nasdaq.com/videos/tradetalks%3A-th... 7 https://www.nasdaq.com/videos/tradetalks%3A-th... 8 https://www.nasdaq.com/videos/tradetalks%3A-wh... 9 https://www.nasdaq.com/videos/tradetalks%3A-ho... 10 https://www.nasdaq.com/videos/tradetalks%3A-vo... 11 https://www.nasdaq.com/videos/tradetalks%3A-fi... 12 https://www.nasdaq.com/videos/investing-strate... 13 https://www.nasdaq.com/videos/investing-strate... 14 https://www.nasdaq.com/videos/investing-strate... 15 https://www.nasdaq.com/videos/investing-strate... 16 https://www.nasdaq.com/videos/investing-strate... 17 https://www.nasdaq.com/videos/investing-strate... 18 https://www.nasdaq.com/videos/investing-strate... 19 https://www.nasdaq.com/videos/investing-strate... 20 https://www.nasdaq.com/videos/investing-strate... 21 https://www.nasdaq.com/videos/investing-strate... 22 https://www.nasdaq.com/videos/how-clean-is-the... 23 https://www.nasdaq.com/videos/whiskey-as-a-cov... 24 https://www.nasdaq.com/videos/a-cyclical-move-... 25 https://www.nasdaq.com/videos/ignoring-science... 26 https://www.nasdaq.com/videos/markets-undergoi... 27 https://www.nasdaq.com/videos/its-getting-toug... 28 https://www.nasdaq.com/news-and-insights/in-th... 46 https://www.nasdaq.com/articles/daily-markets%... 62 https://www.nasdaq.com/article/invesco-qqq-cel... 63 https://www.nasdaq.com/solutions/midpoint-exte... Name: url, dtype: object
df_dates = df.dropna(subset=['published']).sort_values(by=['published'], inplace=False, ascending=False) #drop rows that did not load the published dates, and sort by date published
df_dates
| url | title | published | authors | summary | keywords | videos | |
|---|---|---|---|---|---|---|---|
| 29 | https://www.nasdaq.com/articles/iphone-12-coul... | iPhone 12 Could Be a Tailwind for Apple’s Acce... | 2020-10-23 | [Marty Shtrubel] | Apple’s (AAPL) accessories business might make... | [aapl, tailwind, 12, opinions, feature, access... | [] |
| 56 | https://www.nasdaq.com/articles/dominion-energ... | Dominion Energy (D) Stock Sinks As Market Gain... | 2020-10-23 | [Zacks Equity Research] | Dominion Energy (D) closed at $81.14 in the la... | [sinks, energy, d, stock, ratio, gains, estima... | [] |
| 53 | https://www.nasdaq.com/articles/target-tgt-out... | Target (TGT) Outpaces Stock Market Gains: What... | 2020-10-23 | [Zacks Equity Research] | On that day, TGT is projected to report earnin... | [tgt, ratio, stock, estimate, gains, stocks, s... | [] |
| 52 | https://www.nasdaq.com/articles/bp-bp-stock-si... | BP (BP) Stock Sinks As Market Gains: What You ... | 2020-10-23 | [Zacks Equity Research] | In the latest trading session, BP (BP) closed ... | [sinks, reflect, revisions, stock, estimate, g... | [] |
| 47 | https://www.nasdaq.com/articles/wall-st-week-a... | Wall St Week Ahead-More U.S. companies offer e... | 2020-10-23 | [David Randall] | By David RandallNEW YORK, Oct 23 (Reuters) - W... | [sp, investors, far, week, offer, pandemic, re... | [] |
| 30 | https://www.nasdaq.com/articles/covid-19-is-dr... | COVID-19 Is Driving a Surge in E-Commerce Ad S... | 2020-10-23 | [Evan Niu] | That's also causing a related surge in ad spen... | [covid19, surge, fool, ad, revenue, ecommerce,... | [] |
| 42 | https://www.nasdaq.com/articles/is-the-market-... | Is the Market Reaction to Intel's (INTC) Earni... | 2020-10-23 | [] | It is not unusual for a stock to fall followin... | [stock, good, growth, revenue, intc, billion, ... | [] |
| 55 | https://www.nasdaq.com/articles/hanesbrands-hb... | HanesBrands (HBI) Stock Sinks As Market Gains:... | 2020-10-23 | [Zacks Equity Research] | In the latest trading session, HanesBrands (HB... | [sinks, trading, hbi, stock, stocks, gains, ra... | [] |
| 54 | https://www.nasdaq.com/articles/united-parcel-... | United Parcel Service (UPS) Stock Sinks As Mar... | 2020-10-23 | [Zacks Equity Research] | United Parcel Service (UPS) closed at $171.90 ... | [sinks, service, transportation, ratio, gained... | [] |
| 57 | https://www.nasdaq.com/articles/noble-midstrea... | Noble Midstream Partners (NBLX) Stock Sinks As... | 2020-10-23 | [Zacks Equity Research] | Noble Midstream Partners (NBLX) closed at $9.0... | [sinks, trading, revisions, stock, estimate, g... | [] |
| 58 | https://www.nasdaq.com/articles/ciena-cien-sto... | Ciena (CIEN) Stock Sinks As Market Gains: What... | 2020-10-23 | [Zacks Equity Research] | Our research shows that these estimate changes... | [sinks, ciena, ratio, stock, estimate, gains, ... | [] |
| 59 | https://www.nasdaq.com/articles/enbridge-enb-s... | Enbridge (ENB) Stock Sinks As Market Gains: Wh... | 2020-10-23 | [Zacks Equity Research] | In the latest trading session, Enbridge (ENB) ... | [sinks, enbridge, ratio, enb, stock, estimate,... | [] |
| 33 | https://www.nasdaq.com/articles/forget-5g%3A-t... | Forget 5G: This Tech Stock Trend Is Generating... | 2020-10-23 | [Leo Sun] | A wide range of industries will benefit from t... | [snowflake, silobusting, stock, trend, forget,... | [] |
| 32 | https://www.nasdaq.com/articles/the-advantages... | The Advantages of Blockchain over Traditional ... | 2020-10-23 | [] | By eliminating middlemen, cross-border blockch... | [funds, stack, transaction, trust, payments, b... | [] |
| 31 | https://www.nasdaq.com/articles/the-pandemic-s... | The pandemic shopping list: Dolls, detergent a... | 2020-10-23 | [Uday Sampath] | Oct 23 (Reuters) - Consumers have been snappin... | [quarterly, views, list, dolls, robot, revenue... | [] |
| 38 | https://www.nasdaq.com/articles/intel-intc-3rd... | Intel (INTC) 3rd Quarter Earnings: What to Expect | 2020-10-22 | [] | Chip stocks have caught fire, thanks to strong... | [3rd, company, billion, revenue, intc, strong,... | [] |
| 43 | https://www.nasdaq.com/articles/the-market-is-... | The Market Is Focused on Stimulus; Will It Com... | 2020-10-22 | [] | For a few weeks now, the stock market seems to... | [stimulus, weeks, democrats, thing, focused, c... | [] |
| 39 | https://www.nasdaq.com/articles/microsoft-msft... | Microsoft (MSFT) 1st Quarter Earnings: What to... | 2020-10-21 | [] | The software giant is set to report first quar... | [microsofts, cloud, 1st, azure, billion, growt... | [] |
| 40 | https://www.nasdaq.com/articles/tesla-tsla-3rd... | Tesla (TSLA) 3rd Quarter Earnings: What to Expect | 2020-10-21 | [] | Tesla's strong stock surge has been driven by ... | [3rd, vehicles, company, vehicle, totals, reve... | [] |
| 44 | https://www.nasdaq.com/articles/the-reaction-t... | The Reaction to Netflix's (NFLX) Earnings: Déj... | 2020-10-21 | [] | Netflix (NFLX) released earnings after the bel... | [released, political, nflx, growth, revenue, t... | [] |
| 48 | https://www.nasdaq.com/articles/why-investors-... | Why Investors Should Be Upbeat About Exxon Mobil | 2020-10-21 | [Chris Tyler] | InvestorPlace - Stock Market News, Stock Advic... | [shares, investors, stock, oil, exxon, income,... | [] |
| 49 | https://www.nasdaq.com/articles/top-stock-trad... | Top Stock Trades for Thursday: SNAP, FB, PINS,... | 2020-10-21 | [Bret Kenwell] | InvestorPlace - Stock Market News, Stock Advic... | [trades, shares, trading, pypl, stock, pins, t... | [] |
| 50 | https://www.nasdaq.com/articles/plug-workhorse... | Plug Workhorse Stock into Your Trading Portfol... | 2020-10-21 | [Nicolas Chahine] | InvestorPlace - Stock Market News, Stock Advic... | [workhorse, trading, twice, stock, stocks, tra... | [] |
| 51 | https://www.nasdaq.com/articles/how-good-is-th... | How Good Is the Surf in Ocean Power Technologi... | 2020-10-21 | [Chris Tyler] | Some are seeing dollar signs in Ocean Power Te... | [purchase, energy, stock, technologies, good, ... | [] |
| 41 | https://www.nasdaq.com/articles/netflix-nflx-3... | Netflix (NFLX) 3rd Quarter Earnings: What to E... | 2020-10-20 | [] | Netflix (NFLX) is set to report third quarter ... | [3rd, netflix, company, stock, nflx, billion, ... | [] |
| 45 | https://www.nasdaq.com/articles/u.s.-debt%3A-t... | U.S. Debt: The Elephant in the Room That Keeps... | 2020-10-19 | [] | The elephant referred to back then was the nat... | [trillion, yes, room, gdp, debt, elephant, don... | [] |
| 34 | https://www.nasdaq.com/articles/whats-happenin... | What's Happening With Moderna Stock? | 2020-10-19 | [Trefis Team] | To recall, earlier this month, Moderna agreed ... | [covid19, doses, vaccine, stock, phase, likely... | [] |
| 37 | https://www.nasdaq.com/articles/workhorse-stoc... | Workhorse Stock Could Skyrocket on a U.S. Post... | 2020-10-16 | [Tom Taulli] | InvestorPlace - Stock Market News, Stock Advic... | [service, workhorse, vehicles, company, stock,... | [] |
| 36 | https://www.nasdaq.com/articles/3-high-yield-s... | 3 High-Yield Stocks at Rock-Bottom Prices | 2020-10-16 | [James Brumley] | It's easy to be wary of dividend stocks right ... | [att, lyondellbasell, stock, stocks, interest,... | [] |
| 35 | https://www.nasdaq.com/articles/3-top-5g-stock... | 3 Top 5G Stocks to Buy Right Now | 2020-10-09 | [Leo Sun] | AppleApple is widely expected to reveal the iP... | [apple, skyworks, stock, stocks, earnings, 5g,... | [] |
| 61 | https://www.nasdaq.com/articles/adena-friedman... | Adena Friedman: ESG, AI, Cryptocurrency In Foc... | 2019-01-21 | [] | The world economy is growing more slowly than ... | [focus, markets, public, economic, nasdaq, com... | [] |
| 60 | https://www.nasdaq.com/articles/nasdaqs-johan-... | Nasdaq's Johan Toll Wins FinTech Person of the... | 2018-05-16 | [] | Johan Toll, head of Blockchain Product Managem... | [markets, johan, financial, nasdaq, toll, trad... | [] |
from google.colab import files
df_dates.to_csv('NDX_news_headlines_accessed_2020-10-23.csv', index=False)
files.download('NDX_news_headlines_accessed_2020-10-23.csv')
References:
- NDX News Headlines accessed 23-October-2020.
- Quickstart Guide - Newspaper accessed 18-October-2020.
- Scraping articles about stocks accessed 18-October-2020.
- Scrape and Summarize News Articles by Computer Science accessed 18-October-2020.