[Bf-docboard] Fw: Extract all wiki.blender.org links/sub-pages

[Marcin Cieslak]

On Sat, 2 Jan 2016, hewi jupama wrote:

> Trying to find structure in the wiki.blender.org site, I am trying
> to extract all sub pages, so to find out what lives there.  Is there
> someone with the power of generating such a list (or learn me how to
> fish and create it myself)?

wiki.blender.org runs MediaWiki, which has lots of features
to access its data in a number of different ways.

http://wiki.blender.org/index.php/Special:Statistics

says that there are now:

Content pages    9,953
Pages (All pages in the wiki, including talk pages, redirects, etc.)  51,618
Uploaded files  16,506

You can see all the pages on a wiki by watching:

http://wiki.blender.org/index.php/Special:AllPages

this list would be normally too long so you are offered groups
sorted alphabetically.

There is a special page that allows you to export
arbitrary part of the wiki's content in its source
form:

http://wiki.blender.org/index.php/Special:Export

If you would like to list, process and download wiki
content using some kind of a script or a program,
MediaWiki offers a great API interface:

http://wiki.blender.org/api.php

For example this query starts to enumerate wiki pages:

http://wiki.blender.org/api.php?action=query&generator=allpages

You might want to use a registered wiki account to have larger
transfer limits.

MediaWiki handbook:

https://meta.wikimedia.org/wiki/Help:Contents

API documentation:

https://www.mediawiki.org/wiki/API:Main_page


Saper