Volunteer:Development/DabbleDB integration
From Gospel Translations
(New page: In order for Gospel Translations to stay well organized with minimal load on volunteers, we needed to find a way to automate the insertion of the "About this Resource" box into articles. ...) |
m (moved Gospel Translations:Technology/DabbleDB integration to Volunteer:Development/DabbleDB integration) |
||
(2 intermediate revisions not shown) | |||
Line 1: | Line 1: | ||
+ | __NOTOC__ | ||
In order for Gospel Translations to stay well organized with minimal load on volunteers, we needed to find a way to automate the insertion of the "About this Resource" box into articles. | In order for Gospel Translations to stay well organized with minimal load on volunteers, we needed to find a way to automate the insertion of the "About this Resource" box into articles. | ||
- | |||
- | 0 | + | ==How it works== |
+ | ====Step 0==== | ||
+ | All of our article information and activity records are stored in an online database at DabbleDB, which produces real-time data exports for us upon request. | ||
- | 1 | + | ====Step 1==== |
+ | A cronjob runs every 5 minutes on our web server to import the most up-to-date information from DabbleDB. It arrives in text format like this: | ||
::10 Reasons Why I Am Thankful for the God-Breathed Bible<br>Resource: 10 Reasons Why I Am Thankful for the God-Breathed Bible<br>Resource » Book/series: Taste and See<br>Resource » Author: John Piper<br>Resource » Second Author: None<br>Resource » Publisher: Desiring God<br>Resource » Topic: Spiritual Growth<br>Resource » Subtopic: The Bible<br>Resource » Media Type: Article<br>Resource » Date: November 20, 2006<br>Resource » Sort Order: 0<br>Translator: Zo Tin Khuma<br>Language: Burmese<br>Review Status: Not Reviewed<br> | ::10 Reasons Why I Am Thankful for the God-Breathed Bible<br>Resource: 10 Reasons Why I Am Thankful for the God-Breathed Bible<br>Resource » Book/series: Taste and See<br>Resource » Author: John Piper<br>Resource » Second Author: None<br>Resource » Publisher: Desiring God<br>Resource » Topic: Spiritual Growth<br>Resource » Subtopic: The Bible<br>Resource » Media Type: Article<br>Resource » Date: November 20, 2006<br>Resource » Sort Order: 0<br>Translator: Zo Tin Khuma<br>Language: Burmese<br>Review Status: Not Reviewed<br> | ||
- | 2 | + | ====Step 2==== |
+ | When the data is imported, it gets pushed through a PHP script that breaks it into a multidimensional array and saves it to a flat file using PHP's <code>serialize</code> function, in this format: | ||
:<code>$db[ Language ][ Article Title ][ attribute ] => value</code> | :<code>$db[ Language ][ Article Title ][ attribute ] => value</code> | ||
For instance | For instance | ||
:<code>$db['Spanish']['Gospel Implications']['Publisher'] => "Ligonier Ministries"</code> | :<code>$db['Spanish']['Gospel Implications']['Publisher'] => "Ligonier Ministries"</code> | ||
- | 3 | + | Here is a portion of the output from <code>print_r($db)</code> |
+ | <pre> | ||
+ | Array | ||
+ | ( | ||
+ | [Burmese] => Array | ||
+ | ( | ||
+ | [10 Reasons Why I Am Thankful for the God-Breathed Bible] => Array | ||
+ | ( | ||
+ | [Name] => 10 Reasons Why I Am Thankful for the God-Breathed Bible | ||
+ | [Book/series] => Taste and See | ||
+ | [Author] => John Piper | ||
+ | [Second Author] => None | ||
+ | [Publisher] => Desiring God | ||
+ | [Topic] => Spiritual Growth | ||
+ | [Subtopic] => The Bible | ||
+ | [Media Type] => Article | ||
+ | [Date] => November 20, 2006 | ||
+ | [Sort Order] => 0 | ||
+ | [Translator] => Zo Tin Khuma | ||
+ | [Language] => Burmese | ||
+ | [Review Status] => Not Reviewed | ||
+ | [Reviewer] => None | ||
+ | ) | ||
+ | |||
+ | [Gospel Implications] => Array | ||
+ | ( | ||
+ | [Name] => Gospel Implications | ||
+ | [Book/series] => Article | ||
+ | [Author] => Mike Bullmore | ||
+ | [Second Author] => None | ||
+ | [Publisher] => 9Marks | ||
+ | [Topic] => Church Leadership | ||
+ | [Subtopic] => Pastoral Ministry | ||
+ | [Media Type] => Article | ||
+ | [Date] => September 19, 2007 | ||
+ | [Sort Order] => 0 | ||
+ | [Translator] => Hrang Hmung | ||
+ | [Language] => Burmese | ||
+ | [Review Status] => Not Reviewed | ||
+ | [Reviewer] => None | ||
+ | ) | ||
+ | |||
+ | ) | ||
+ | ) | ||
+ | </pre> | ||
+ | |||
+ | ====Step 3==== | ||
+ | Meanwhile, every article or book on our wiki calls a [http://www.mediawiki.org/wiki/Help:Templates template], <code>[[Template:Info|<nowiki>{{Info}}</nowiki>]]</code>. The <code><nowiki>{{Info}}</nowiki></code> template figures out the language (<code>$resLang</code>) and title (<code>$res</code>) of the article and runs our custom [http://www.mediawiki.org/wiki/Manual:Parser_functions parser function], <code><nowiki>{{#ib:}}</nowiki></code>. So this call | ||
::<code>$db[ $resLang ][ $res ]['Publisher']</code> | ::<code>$db[ $resLang ][ $res ]['Publisher']</code> | ||
will return the publisher of the given article. | will return the publisher of the given article. | ||
- | 4 | + | ====Step 4==== |
+ | <code><nowiki>{{#ib:}}</nowiki></code> tries to find <code>$db[ $resLang ][ $res ]</code>, and if successful it returns the code for the "About this Resource" box (including several <code><nowiki>[[Category:xx]]</nowiki></code> tags to help the wiki sort its content). | ||
...and that is how the info automation with DabbleDB works. | ...and that is how the info automation with DabbleDB works. | ||
+ | |||
+ | [[Category:Tech admin]] |
Current revision as of 19:06, 17 December 2009
In order for Gospel Translations to stay well organized with minimal load on volunteers, we needed to find a way to automate the insertion of the "About this Resource" box into articles.
How it works
Step 0
All of our article information and activity records are stored in an online database at DabbleDB, which produces real-time data exports for us upon request.
Step 1
A cronjob runs every 5 minutes on our web server to import the most up-to-date information from DabbleDB. It arrives in text format like this:
- 10 Reasons Why I Am Thankful for the God-Breathed Bible
Resource: 10 Reasons Why I Am Thankful for the God-Breathed Bible
Resource » Book/series: Taste and See
Resource » Author: John Piper
Resource » Second Author: None
Resource » Publisher: Desiring God
Resource » Topic: Spiritual Growth
Resource » Subtopic: The Bible
Resource » Media Type: Article
Resource » Date: November 20, 2006
Resource » Sort Order: 0
Translator: Zo Tin Khuma
Language: Burmese
Review Status: Not Reviewed
- 10 Reasons Why I Am Thankful for the God-Breathed Bible
Step 2
When the data is imported, it gets pushed through a PHP script that breaks it into a multidimensional array and saves it to a flat file using PHP's serialize
function, in this format:
$db[ Language ][ Article Title ][ attribute ] => value
For instance
$db['Spanish']['Gospel Implications']['Publisher'] => "Ligonier Ministries"
Here is a portion of the output from print_r($db)
Array ( [Burmese] => Array ( [10 Reasons Why I Am Thankful for the God-Breathed Bible] => Array ( [Name] => 10 Reasons Why I Am Thankful for the God-Breathed Bible [Book/series] => Taste and See [Author] => John Piper [Second Author] => None [Publisher] => Desiring God [Topic] => Spiritual Growth [Subtopic] => The Bible [Media Type] => Article [Date] => November 20, 2006 [Sort Order] => 0 [Translator] => Zo Tin Khuma [Language] => Burmese [Review Status] => Not Reviewed [Reviewer] => None ) [Gospel Implications] => Array ( [Name] => Gospel Implications [Book/series] => Article [Author] => Mike Bullmore [Second Author] => None [Publisher] => 9Marks [Topic] => Church Leadership [Subtopic] => Pastoral Ministry [Media Type] => Article [Date] => September 19, 2007 [Sort Order] => 0 [Translator] => Hrang Hmung [Language] => Burmese [Review Status] => Not Reviewed [Reviewer] => None ) ) )
Step 3
Meanwhile, every article or book on our wiki calls a template, {{Info}}
. The {{Info}}
template figures out the language ($resLang
) and title ($res
) of the article and runs our custom parser function, {{#ib:}}
. So this call
$db[ $resLang ][ $res ]['Publisher']
will return the publisher of the given article.
Step 4
{{#ib:}}
tries to find $db[ $resLang ][ $res ]
, and if successful it returns the code for the "About this Resource" box (including several [[Category:xx]]
tags to help the wiki sort its content).
...and that is how the info automation with DabbleDB works.