trafilatura

Repository

Extracts web page text, authors, titles, and dates while removing headers, footers, and other clutter.

Overview

Use case: Source-backed content preparation

A Python package with a command-line interface for collecting web text, metadata, and optional comments. It separates main content from repeated headers, footers, and boilerplate, and exports results in several structured or text formats.

Researchers building text collections can process live URLs or saved HTML, discover pages through sitemaps and feeds, and filter duplicate URLs. Python functions and command-line workflows support collection without requiring a database.

Source-based overview · Not hands-on tested.

Good for

Extract article text without navigation clutter
Collect page titles, authors, and dates
Convert saved HTML into structured text
Discover URLs through sitemaps and feeds

Price

Not stated

Setup

Technical setup (inferred)
Use the package through Python functions or its command-line interface. The README links installation guidance and usage documentation; a database is unnecessary.

Change history

No substantive changes recorded. A successful source check alone is not a change.

Links work · Not hands-on tested · Recently active: source activity within 14 days · Updated: recorded change this week

Compare all candidates →

Licence, sources & verification

Listing facts

Apache-2.0

Listing facts
Source	https://github.com/adbar/trafilatura
Author credit	adbar on GitHub
Licence	Apache-2.0
Use case / type	Source-backed content preparation · repository

Open action link

Evidence

Source-discovered · Not hands-on tested · Links not checked

Source activity date: 21 Oct 2026
Checked: 22 Oct 2026 · Imported from a source snapshot; not independently rechecked
Source-metadata observation: Not recorded

Source: Not checked; availability unconfirmed

Workflow context

Intended task: Prepare a draft, inspect its claims, and keep the receipts.
Setup: Technical setup (inferred)
Use the package through Python functions or its command-line interface. The README links installation guidance and usage documentation; a database is unnecessary.
Prerequisites: Review repository setup instructions, runtime, model access and API credentials; exact requirements are not established here.
Limitations: Source checking does not prove functionality. No hands-on test was performed. Capabilities and availability are unconfirmed.
Price: Not stated

Attribution & reuse

Source: adbar on GitHub.

Repository licence: Apache-2.0 (check the repository for scope).

Changes made: summary paraphrased from the repository description with AI assistance, plus task tags; no README text, code or media reproduced.

Recorded modifications: summary written by TaskToTool in its own words from the repository's GitHub description; reviewed against the live source on 2026-10-22.

Editorial provenance

Summary written by TaskToTool from public source information; not hands-on tested.

Python library and command-line tool that collects text and metadata from web pages and exports it as CSV, JSON, HTML, Markdown, TXT or XML.

Not hands-on tested.

AI-assisted drafting; reviewed by TaskToTool

Reviewed by TaskToTool Content Editor · 22 Oct 2026

How we write and verify listings: AI assistance, evidence labels and dates