Audience researchers
Reaction analysis
Favorable to scraping
Collect Yahoo News comments and reaction counts into a repeatable CSV, then group responses by article, topic, time window, or sentiment workflow.
News$50Free
Yahoo News Comments Scraper for CSV Export
This Yahoo News comments scraper turns Yahoo News article discussion pages into a structured CSV. Import the workflow into the UScraper local desktop app, paste one or more article URLs, and export article title, URL, commenter ID, time, comment text, replies, and reaction counts without writing browser automation code.
Output
CSV
Columns
14
Inputs
Multi-URL
Waits
Built in
Template
Free
At a glance
Export Yahoo News comments without building a crawler
The template starts with editable Yahoo News article URLs. If a URL points to a normal news.yahoo.co.jp/articles/ article, the workflow redirects it to the matching /comments page, waits for the page body, scrolls, and checks for Japanese controls such as "もっと見る", "さらに表示", and "次へ". When those controls are available, UScraper clicks and loops until the visible thread is expanded.
After the interaction loop finishes, a normalization step creates hidden export rows from the visible comments. Each row keeps the article context and separates parent comment data from reply data, so you can analyze thread structure instead of flattening everything into one text blob.
Parent comments and replies
Export parent commenter ID, timestamp, comment text, and the paired reply fields in the same row when Yahoo exposes nested discussion content.
Reaction counts included
Capture Japanese reaction labels such as 共感した, なるほど, and うーん for parent comments and replies.
Local desktop workflow
Your input URLs and CSV stay in your local run unless you add your own upload, sync, or reporting step.
Diagnostic rows for empty pages
Deleted articles, disabled comments, or changed markup produce a readable diagnostic row instead of silently creating an empty file.
Who this is for
Use cases for Yahoo News comment exports
Editorial and comms teams
Issue tracking
Favorable to scraping
Monitor how readers respond to public stories and preserve article URLs beside comment text for review, escalation, or internal reporting.
Data analysts
Thread structure
Nuanced outcome
Use parent and reply columns for lightweight conversation analysis before joining results with the Yahoo News Scraper article export.
For wider research, pair this template with the Google News Scraper, Yahoo Search Scraper, and YouTube Comments Scraper. The broader UScraper template library helps you keep article, search, and discussion exports in the same workflow style.
How to use
Configure the Yahoo News comments scraper
2
Add article URLs
Replace the sample URLs in the Navigate block with live Yahoo News article URLs. Keep a small first batch so deleted or comment-disabled pages are easy to spot.
3
Review the comments redirect
The workflow converts valid article URLs to their /comments view, waits for the page, then confirms the body is visible before scrolling.
4
Let the loop expand comments
UScraper scrolls, checks for load-more or next controls, clicks them when present, sleeps briefly, and loops until no more visible controls are detected.
5
Export and open the CSV
Structured Export appends rows to yahoo-news-comments-scraper.csv with headers. Open the file in Excel, Sheets, or your analysis pipeline.
Output preview
What the Yahoo News comments CSV contains
The export uses one row per normalized parent comment or parent-reply pair. If Yahoo returns a deleted article page, blocks comments, or changes the visible markup, the template writes a diagnostic message in the Comment column so failed inputs are traceable.
| Article | URL | ID | Time | Comment | 共感した | なるほど | うーん | Reply_ID | Reply_Time | Reply |
|---|---|---|---|---|---|---|---|---|---|---|
| Major policy story draws public reaction | https://news.yahoo.co.jp/articles/example-a | user_1842 | 2時間前 | This decision will affect local services, so I want clearer numbers from officials. | 21 | 8 | 3 | user_918 | 1時間前 | The budget detail matters more than the headline. |
| Market update sparks debate | https://news.yahoo.co.jp/articles/example-b | reader_77 | 昨日 | Export demand looks stronger, but prices are still the issue for households. | 14 | 5 | 6 | |||
| Deleted article sample | https://news.yahoo.co.jp/articles/missing | NO_COMMENTS_FOUND: Yahoo returned a deleted/not-found article page for this URL. |
yahoo-news-comments-scraper.csvColumn
Article
Article title from the page heading, Open Graph title, or document title.
Column
URL
Article URL with the comments suffix removed for cleaner joins.
Column
ID
Parent commenter identifier when visible.
Column
Time
Relative Yahoo timestamp such as 2時間前, 昨日, or 3日前.
Column
Comment
Parent comment text or a diagnostic message for missing comments.
Column
共感した
Parent sympathetic reaction count.
Column
なるほど
Parent agreement or understanding reaction count.
Column
うーん
Parent skeptical reaction count.
Column
Reply_ID
Reply author identifier when a reply is paired with the parent row.
Column
Reply_Time
Reply timestamp when visible.
Column
Reply
Reply body text.
Column
Reply_共感した
Reply sympathetic reaction count.
Column
Reply_なるほど
Reply agreement reaction count.
Column
Reply_うーん
Reply skeptical reaction count.
Headers included - multi-URL runs append comment rows into one local file
Frequently asked questions
Yahoo News comments may be publicly visible, but automated collection can still be limited by Yahoo terms, community rules, robots directives, privacy law, and local scraping regulations. Use modest runs, avoid bypassing access controls, and get legal review before using comment exports commercially.
Before you run
Practical limits and maintenance notes
Keep these constraints visible
Rate limits
High-frequency runs can trigger friction
Add pauses for larger batches and avoid parallelizing many article pages at once. CAPTCHA, login walls, slow pages, and blocked responses should be treated as stop signals, not obstacles to bypass.
Selector drift
Yahoo can change the comments layout
The template uses a best-effort parser based on visible text, timestamps, and reaction labels. If comment text, replies, or reaction counts disappear, inspect a fresh page and update the normalization step.
Compliance
Comments can contain personal data
Treat commenter IDs, timestamps, and text as user-generated content. Minimize collection, store files securely, and do not republish or profile users without a clear legal basis.
Download the template, install the desktop app from UScraper download, and use it when you need to export Yahoo comments into a reviewable local CSV.
Get Started
Download and use this template instantly
$50Free
What's Included
- Template JSON file ready to import
- Pre-configured scraping nodes
- Works with UScraper desktop app
Open-source templates
UScraper templates are open source. Improve this workflow or contribute a new one to help the community grow.
Contribute on GitHubBrowse more templates in the library
All Templates