Google News Topic Scraper

What is Google News Topic Scraper and how does it work?

Google News Topic Scraper is a web scraping tool that enables you to extract news article data from Google News using specific topics. This tool helps you gather detailed information about news articles, including headlines, sources, publication dates, and content.

How to use Google News Topic Scraper:

1. Enter Topics: Input the topics you want to search for on Google News.
2. Run Scraper: Paste the links to the desired web pages into the Job configurator and run it.
3. Extract Data: The scraper will collect headlines, sources, publication dates, and article content related to the specified topics.
4. Download Data: The extracted data can be downloaded in various structured formats.

Why scrape Google News Articles?

Scraping Google News articles can help you:

➡️ Monitor news trends and topics.

➡️ Analyze media coverage from various sources.

➡️ Enhance your content strategies with up-to-date news information.

How many results can you scrape with Google News Topic Scraper?

Google News Topic Scraper can return a large number of news articles based on the specified topics. The exact number of results may vary depending on the input parameters. Conducting a test run is recommended to determine the output for your specific needs.

How much will scraping Google News Articles cost you?

The cost of scraping will depend on the volume of data and the frequency of scraping. Each Google News link will cost you a 10 credits with web browser rendering and 1 credit without web browser rendering.

IMPORTANT

This website will pre-load and parse incorrectly without web browser rendering.

Sample output from Google News Topic Scraper

{
    "type": "main",
    "topic_name": "World",
    "headers": [
        {
            "type": "header",
            "title": "Latest Israel-Hamas war news and Gaza conflict updates",
            "url": "https://news.google.com/topics/articles/CBMiW2h0dHBzOi8vd3d3Lndhc2hpbmd0b25wb3N0LmNvbS93b3JsZC8yMDI0LzA1LzE1L2lzcmFlbC1oYW1hcy13YXItbmV3cy1nYXphLXBhbGVzdGluZS1yYWZhaC_SAQA?hl=en-US&gl=US&ceid=US%3Aen",
            "image_url": "https://news.google.com/api/attachments/CC8iK0NnNWlaa3A1UmkxVmRqQjRjMjh3VFJDZkF4ampCU2dLTWdZQk1JcnFsUWM=-w280-h168-p-df-rw",
            "source": "The Washington Post",
            "author": "Louisa Loveluck, Jennifer Hassan & John Hudson",
            "publish_date": "17 minutes ago",
            "publish_timestamp": "2024-05-15T14:25:36Z",
            "related": [
                {
                    "type": "related_header",
                    "title": "Biden advances $1 billion in arms for Israel amid Rafah tensions",
                    "url": "https://news.google.com/topics/articles/CBMiXGh0dHBzOi8vd3d3Lndhc2hpbmd0b25wb3N0LmNvbS9uYXRpb25hbC1zZWN1cml0eS8yMDI0LzA1LzE0L2JpZGVuLWlzcmFlbC13ZWFwb25zLWdhemEtcmFmYWgv0gEA?hl=en-US&gl=US&ceid=US%3Aen",
                    "source": "The Washington Post",
                    "author": "John Hudson",
                    "publish_date": "10 hours ago",
                    "publish_timestamp": "2024-05-15T03:45:00Z",
                    "xpath": "/html[1]/body[1]/c-wiz[1]/div[1]/main[1]/c-wiz[1]/c-wiz[1]/c-wiz[1]/c-wiz[1]/div[1]/div[1]/article[1]",
                    "stream_position": 1232551
                }
            ],
            "xpath": "/html[1]/body[1]/c-wiz[1]/div[1]/main[1]/c-wiz[1]/c-wiz[1]/c-wiz[2]",
            "stream_position": 1246256
        },
        {
            "type": "header",
            "title": "Gaza death toll: how many Palestinians has Israel's campaign killed",
            "url": "https://news.google.com/topics/articles/CBMid2h0dHBzOi8vd3d3LnJldXRlcnMuY29tL3dvcmxkL21pZGRsZS1lYXN0L2dhemEtZGVhdGgtdG9sbC1ob3ctbWFueS1wYWxlc3RpbmlhbnMtaGFzLWlzcmFlbHMtY2FtcGFpZ24ta2lsbGVkLTIwMjQtMDUtMTQv0gEA?hl=en-US&gl=US&ceid=US%3Aen",
            "image_url": "https://news.google.com/api/attachments/CC8iK0NnNUZlSEF0U21wdVptTTFWVzFrVFJERUF4aW1CU2dLTWdZQkFJVG1uQVE=-w200-h112-p-df-rw",
            "source": "Reuters.com",
            "author": null,
            "publish_date": "Yesterday",
            "publish_timestamp": "2024-05-14T14:03:00Z",
            "related": null,
            "xpath": "/html[1]/body[1]/c-wiz[1]/div[1]/main[1]/c-wiz[1]/c-wiz[1]/c-wiz[51]",
            "stream_position": 2235360
        }
    ],
    "xpath": "/html[1]",
    "stream_position": 15
}