Tsutsei Software
Google News Scraper icon

Google News Scraper

Articles with real publisher URLs from all 84 Google News editions

This Google News scraper returns the articles of a keyword search, a topic, the top stories or the local news of a town as clean rows, in any of the 84 country and language editions. The part where most tools stop is the link. A Google News link no longer carries the address of the article, so a list of headlines is hard to deduplicate or to sort by website. Here every article gets its real publisher URL, with the Google link kept next to it.

Try it on Apify Store See examples

Countries
ALL
Output
JSON · CSV · Excel · API
Monitoring
New and changed only
Updated

tsutseisoftware/google-news-scraperdataset · item 1

publisher"Axios"
domain"axios.com"
urlResolvedtrue
author"Ina Fried"
relatedCount6
rank1
sourceType"topic"
topic"BUSINESS"

One row per article. Download as JSON, CSV or Excel, or read it through the API.

Overview

What you get from Google News

Searches accept the operators you know from Google: an exact phrase in quotes, OR, a minus sign, site:, intitle: and dates. On top of that there are plain switches for an exact phrase, words in the title only, words to leave out, only selected publishers or all but a few, a timeframe from the past hour to the past year, or a date range. Topics such as business, technology or sports, the top stories of an edition, the local news of a place and any Google News URL you paste work as well, and one run can cover several editions. Czech and Slovak news work the same way as the US edition.

Every row has the headline, the publisher and its home page, the article URL without tracking parameters, the domain, the Google link and the time of publication. From the publisher's page come the description, the main image, the author, the publisher's own keywords and the time of the last update. Related coverage that Google groups with a story comes as a list with the other publishers. The full text of the article is optional and charged only when text was really extracted; a paywalled page gives its free part or nothing.

Not every publisher lets automated visitors read its pages, and some put a cookie wall in front, so the page fields are filled for most articles rather than all of them. E-mails and phone numbers in descriptions and texts are replaced with a placeholder. Names of journalists and of people in the news are not removed.

In detail

Past the 100-article limit, with news alerts

A Google News search answers about 100 articles at most, and fewer when the range spans several days. Expanded search reads the range one day at a time, newest first, and stops once Max articles is reached. In our test one week read this way gave 212 articles where a single search gave 93. The status message then lists the days that were still at Google's limit, so you know where more could be.

The same story often turns up under several keywords or editions. It is saved once, Skip similar stories keeps one article per story, and storyId lets you group the copies yourself. For brand and media monitoring, schedule the run with only new articles: articles you already have are not saved and not charged, and the new ones go to Slack, Discord, Telegram or a webhook (Zapier, Make, n8n). A free summary of each run counts articles per keyword, topic and publisher and shows the top domains.

Features

Why use this Google News scraper

  • Real publisher URLs

    in url (tracking parameters removed), the Google link in googleUrl, and urlResolved saying which one you got. Articles Google doesn't let the actor decode don't pay the URL part of the price.

  • Every way to search

    keywords with Google operators ("exact phrase", OR, -word, site:, intitle:, when:, after:, before:), plus switches for exact phrase, keywords in the title only, exclude words, only these publishers, exclude publishers, timeframe (past hour to past year) and a date range.

  • Topics, top stories and local news

    of any edition, hashed topic and section URLs, publication URLs and Google News RSS URLs you paste.

  • All 84 editions

    (United States, United Kingdom, Germany, France, Czechia, Slovakia, Poland, Brazil, Japan…), several in one run.

  • Expanded search

    past Google's ~100-article limit, with honest completeness reporting.

  • Description, image, author, keywords and update time

    from the publisher's page, included in the price.

  • Full article text

    (optional, charged only for articles whose text was extracted): cookie walls, paywall notices and anti-bot pages give no text and no charge.

  • Related coverage

    of each story (other publishers Google groups with it), with their publisher URLs when known.

  • Duplicates under control

    an article found by several keywords or editions is saved once; Skip similar stories keeps one article per story (same or nearly the same headline, and Google's own grouping); storyId lets you group copies yourself.

  • Sort

    by Google's order (relevance), newest or oldest first; Max articles and Max articles per source.

  • Monitoring and alerts

    only new articles (optionally updated headlines), Slack, Discord, Telegram, WhatsApp, webhook (Zapier, Make, n8n).

  • Free run summary

    (SUMMARY record): articles per keyword, topic and publisher, top domains, how the URLs were found, which searches or days hit Google's limit.

  • Compact output

    for AI agents and MCP clients.

  • Privacy first

    e-mails and phone numbers in descriptions and texts are replaced with [e-mail removed] / [phone removed]. Publisher pages are read at most once a second per website.

Who uses it

Who uses the Google News scraper

  • PR and communications teams

    Track every mention of a company or its CEO and get a Slack message each hour when something new is published.

  • Media monitoring services

    Collect articles for clients across editions and group them by publisher domain, which the real article URL makes possible.

  • Researchers and analysts

    Pull every article on a subject for a whole month, day by day, and count coverage by publisher or country.

  • Investors and market watchers

    Follow business top stories and news about a list of companies in several countries at once.

  • AI and data teams

    Feed headlines, links and the optional full text into a model, with compact rows through the Apify API or MCP.

Output fields

What data can you get

FieldExample
title, publisher, publisherUrlJensen Huang's looming ouster triggers an AI earthquake, Axios, https://www.axios.com
url, urlResolved, domainhttps://www.axios.com/2026/11/12/jensen-huang-nvidia-board, true, axios.com
googleUrl, articleIdhttps://news.google.com/read/CBMiakFV…
publishedAt, modifiedAt2026-11-12T10:08:23Z
description, imageUrl, author, keywordsthe article's summary, main image, byline and tags
relatedArticles, relatedCount, storyIdother coverage of the story (title, publisher, links)
query, topic, sourceType, sourceLabel, rankthe keyword or topic it came from and its position
edition, language, country, textLanguageUS:en, en, US
fullText, fullTextLengthwith Full article text
changeType, firstSeenAtwith monitoring

Step by step

How to scrape Google News

  1. Open the actor in Apify Console and enter Search keywords (or pick Topics, add Local news places or paste Google News URLs).
  2. Choose the Editions (default United States, English).
  3. Optionally narrow it down: Timeframe or dates, publishers, excluded words, Expanded search for more than 100 per keyword.
  4. Set Max articles and click Start.
  5. Download the articles as JSON, CSV or Excel, or get them through the API.

Try it on Apify Store

Examples

Ready-made inputs

Copy an input into the JSON tab of the actor in Apify Console and run it, or change it to your needs.

01Latest news about a company, with publisher URLs

InputJSON

{ "searchQueries": ["Nvidia"], "timeframe": "1d", "maxItems": 100 }
02Czech and Slovak news about elections

InputJSON

{ "searchQueries": ["volby"], "editions": ["CZ:cs", "SK:sk"], "timeframe": "7d", "maxItems": 200 }
03Every article about a topic in October, past the 100 limit

InputJSON

{ "searchQueries": ["electric cars"], "exactPhrase": true, "dateFrom": "2026-10-01", "dateTo": "2026-10-31",
  "expandedSearch": true, "maxItems": 0 }
04Brand monitoring: new mentions every hour, to Slack

InputJSON

{ "searchQueries": ["\"Acme Corp\"", "\"Acme\" CEO"], "timeframe": "1d", "onlyNewArticles": true,
  "monitoringKey": "acme", "slackWebhookUrl": "https://hooks.slack.com/services/…", "maxItems": 0 }
05Only from selected publishers, with the full text

InputJSON

{ "searchQueries": ["central bank"], "onlyPublishers": ["reuters.com", "apnews.com", "bbc.co.uk"],
  "includeFullText": true, "maxItems": 50 }
06Top stories and business news of Germany, one article per story

InputJSON

{ "topics": ["TOP_STORIES", "BUSINESS"], "editions": ["DE:de"], "dedupeSimilarStories": true, "maxItems": 0 }
07Local news of Brno and Ostrava

InputJSON

{ "locations": ["Brno", "Ostrava"], "editions": ["CZ:cs"], "maxItems": 60 }
08Decode Google News links you already have

A link alone has no headline, publisher or date in Google's answer: they come from the publisher's page, so keep Description, image and author on (the default) to get them.

InputJSON

{ "startUrls": [{ "url": "https://news.google.com/rss/articles/CBMiakFVX3lxTE94ak4xcTZteHBzaGNaXzhfWGZ0MzJ0R2VCOEJQSUF0eVhrWUZmUWx6TVhFOGZmVkdOSG1rdm1KbkZKV3YxTTloUnlNeDdTZjRxeHplWmVFaXZ4bUNuYndJRV9zdm9jb1lfZlE?oc=5" }] }
09Small rows for an AI agent

InputJSON

{ "searchQueries": ["AI regulation EU"], "timeframe": "7d", "compact": true, "includeArticleDetails": false, "maxItems": 30 }

Output

Output example

Dataset itemJSON

{
  "id": "google-news:CBMiakFVX3lxTE94ak4xcTZteHBzaGNaXzhfWGZ0MzJ0R2VCOEJQSUF0eVhrWUZmUWx6TVhFOGZmVkdOSG1rdm1KbkZKV3YxTTloUnlNeDdTZjRxeHplWmVFaXZ4bUNuYndJRV9zdm9jb1lfZlE",
  "articleId": "CBMiakFVX3lxTE94ak4xcTZteHBzaGNaXzhfWGZ0MzJ0R2VCOEJQSUF0eVhrWUZmUWx6TVhFOGZmVkdOSG1rdm1KbkZKV3YxTTloUnlNeDdTZjRxeHplWmVFaXZ4bUNuYndJRV9zdm9jb1lfZlE",
  "source": "google-news",
  "title": "Jensen Huang's looming ouster triggers an AI earthquake",
  "publisher": "Axios",
  "publisherUrl": "https://www.axios.com",
  "domain": "axios.com",
  "url": "https://www.axios.com/2026/11/12/jensen-huang-nvidia-board",
  "urlResolved": true,
  "googleUrl": "https://news.google.com/read/CBMiakFVX3lxTE94ak4xcTZteHBzaGNaXzhfWGZ0MzJ0R2VCOEJQSUF0eVhrWUZmUWx6TVhFOGZmVkdOSG1rdm1KbkZKV3YxTTloUnlNeDdTZjRxeHplWmVFaXZ4bUNuYndJRV9zdm9jb1lfZlE",
  "publishedAt": "2026-11-12T10:08:23Z",
  "description": "Nvidia's board is weighing whether its co-founder can stay on…",
  "imageUrl": "https://images.axios.com/….jpeg",
  "author": "Ina Fried",
  "keywords": ["Nvidia", "Jensen Huang"],
  "relatedArticles": [
    { "title": "Nvidia shares slide as board weighs CEO's future", "publisher": "Reuters",
      "googleUrl": "https://news.google.com/read/CBMi…", "url": "https://www.reuters.com/…" }
  ],
  "relatedCount": 6,
  "storyId": "5f1c2a9e0b7d4c31",
  "similarCount": null,
  "rank": 1,
  "sourceType": "topic",
  "query": null,
  "topic": "BUSINESS",
  "sourceLabel": "topic BUSINESS",
  "sourceUrl": "https://news.google.com/rss/headlines/section/topic/BUSINESS?hl=en-US&gl=US&ceid=US:en",
  "edition": "US:en",
  "language": "en",
  "country": "US",
  "pageFetched": true,
  "textLanguage": "en",
  "fullText": null,
  "fullTextLength": null,
  "modifiedAt": "2026-11-12T11:30:00Z",
  "changeType": null,
  "firstSeenAt": null,
  "scrapedAt": "2026-11-12T12:00:00Z"
}

API

For AI agents and API users

from apify_client import ApifyClient

client = ApifyClient("<YOUR_API_TOKEN>")
run = client.actor("tsutseisoftware/google-news-scraper").call(run_input={
    "searchQueries": ["Nvidia"], "timeframe": "1d", "maxItems": 50,
})
for article in client.dataset(run.default_dataset_id).iterate_items():
    print(article["publishedAt"], article["publisher"], article["title"], article["url"])

FAQ

Questions about the Google News Scraper

Is it legal to scrape Google News?

It reads only publicly available data (Google News and the publishers' public article pages), without logging in, at most 150 Google requests per minute and one page per second per publisher website, slows down when the website asks, never changes IP address to get around a limit and never solves captchas or other challenges. It removes e-mails and phone numbers from descriptions and texts. Google's terms say its feeds are for personal, non-commercial use in a feed reader, and publishers' terms and copyright apply to their articles and texts: you are responsible for how you use the data (copyright, database rights, GDPR and the websites' terms); storing or republishing full texts usually needs the publisher's permission. If in doubt, consult a lawyer. This actor is not affiliated with Google or with any publisher.

Why is the publisher URL decoded at all?

Google News links point to news.google.com and open the publisher's page only in a browser. Most tools that read Google News give you only that link. This actor gives the publisher's own URL, so you can open, deduplicate or analyze the articles by website.

Can I get named entities (people, organizations, places)?

Not as a separate extraction: reliable entities need a language model that would make every run slower and more expensive (a model for 84 languages does not fit the small, fast container this actor runs in), and a list of capitalized words is mostly noise. What you get for free is keywords: the tags the publisher itself gave the article (44 % of articles in our measurement), which name the people, companies and places it is about.

How many articles can I get?

About 100 per keyword and edition in one search; with Expanded search about as many per day of the date range. Topics and top stories have 30–70 articles each, local news up to about 70.

Do I need a proxy?

No. Google News answers the Apify servers directly. If Google starts rejecting the requests, try Apify Proxy (automatic group). A RESIDENTIAL proxy works too, but its traffic is paid as Extra page.

Does it work for Czech and Slovak news?

Yes: choose the editions Czechia (Čeština) and Slovakia (Slovenčina). Search keywords, topics and local news (e.g. Brno, Košice) work the same way, and page data and full text work for Czech and Slovak publishers (iDNES.cz shows robots a consent wall, so its articles get page data but no text).

Can I use it from an AI agent or through MCP?

Yes. Apify's MCP server (mcp.apify.com) exposes every actor in the Store as a tool; Compact output keeps the rows small for a model's context.


Also known as a Google News API, Google News RSS scraper, Google News link decoder, news monitoring and media monitoring tool, "Google News scraper Czech" ("zprávy z Google News", "monitoring médií").

Changelog

What changed in the Google News Scraper

  • 2026-11-16 · New: Notifications can also go to WhatsApp (WhatsApp Cloud API of your Meta business account), to up to 5 numbers and with your approved message template so they arrive at any time; wrong notification settings now stop the run at its start, before anything is read.
  • 2026-11-16 · Fixed: A URL, code or search the website rejected or did not answer is reported as not read (try again later), never as not found or as a page that does not exist.
  • 2026-11-15 · New: Send error reports in the Privacy section: turn it off and the actor sends nothing to its developer when a run fails.
  • 2026-11-15 · Fixed: Discord and Slack webhooks are accepted in every form you can copy them in, including Discord beta clients and links in angle brackets; a channel link is refused with advice where to copy the webhook.

Support

Missing a field or a filter?

We read every message and usually answer the same day. Small changes to an actor are free; a custom scraper gets a fixed quote.