Wikidata and Wikipedia language data extraction

Installation

Scribe-Data is available for installation via pip:

pip install scribe-data

The latest development version can further be installed the source code on GitHub:

git clone https://github.com/scribe-org/Scribe-Data.git
cd Scribe-Data
pip install -e .

To utilize the Scribe-Data CLI, you can execute variations of the following command in your terminal:

scribe-data -h  # view the cli options
scribe-data [command] [arguments]

Available Commands

• list (l): Enumerate available languages, data types and their combinations.

• get (g): Retrieve data from Wikidata for specified languages and data types.

• total (t): Display the total available data for given languages and data types.

• convert (c): Transform data returned by Scribe-Data into different file formats.

Contents

• Scribe-Data
  • cli/
  • utils.py
  • check/
  • load/
  • unicode/
  • wikidata/
  • wikipedia/

Contributing

• Contributing to Scribe-Data
  • Contents
  • First steps as a contributor
  • Learning the tech stack
  • Development environment
  • Issues and projects
  • Bug reports
  • Feature requests
  • Pull requests
  • Data edits
  • Documentation
• License

Project Indices

• Index