Knowledge

:Knowledge Signpost/2011-05-30/Technology report - Knowledge

Source 📝

456:. In 2010, however, only 30% of the world had any access at all to the so-called "World Wide Web", even when the high rates of availability found in the developed world are allowed to skew the data (source: CIA World Factbook). Since the Wikimedia Foundation's aim is to "encourage the growth, development and distribution of free, multilingual content", it is clear that either the remaining 70% will have to be supplied with the Internet so they can access the online versions of Wikimedia wikis, or the Wikimedia wikis will have to be provided in an offline-friendly format (in contrast, 50% of the world has used a computer, according to Pew Research). The "Knowledge Offline" project, then, is a WMF initiative aimed at spreading its flagship product freely to the two billion people who use a computer but cannot access the Internet. 90: 468:). The second challenge is the technical one of supplying the information. A current strategy of the Foundation is to continue to make the raw data of Wikipedias available via so-called "dumps", while simultaneously supporting open-source programs that can process these files. In combination, this will allow whole Wikipedias to be either downloaded when an Internet connection is available, or to be shipped on DVDs or other portable media. This runs alongside the Foundation's existing project to select the most useful articles from a given Knowledge, hence condensing an encyclopedia onto a single CD. 909:. If you calculated it yourself based on statistics in the cited source, it is a little misleading to cite that as the source of your conclusion. (Sorry if this seems like nitpicking. Unclear statistical writing is a pet peeve of mine because it is so widespread, even among professional writers. I highly recommend the book linked in my previous edit summary for all journalists (and encyclopedists) who use or report statistics. Despite the tongue-in-cheek title, it is very illuminating about what ought to be common sense but is commonly done wrong.) ~ 669: 169:, Wikimedia wikis underwent a scheduled downtime of one hour on Tuesday 24 May at around 13:00–14:00 UTC. The downtime meant that the Foundation has already missed previous aired targets of limiting downtime to just 5.256 minutes per annum (equivalent to 99.999% uptime) and 52.6 minutes (99.99% uptime) for this calendar year. However, the work does appear to have been successful at reducing the quantity of out-of-date pages served to readers and other similar problems. 117: 107: 200: 33: 127: 87: 137: 97: 839:" — what is that supposed to mean? It's the nature of an average to take both areas with high(er) and lower availability of Internet/WWW access into account. Areas with higher-than-average penetration rates aren't "skewing the data" any more than areas with a lower-than-average penetration rate are. Perhaps a "pure" average is not a good metric here, though. -- 526:). The problem was traced to a complexity in Google's spidering system, which does not equate ordinary characters (such as ":" and "/") with their encoded forms ("%3A" and "%2F"). As a result, effective blocking requires a number of additional variants to be listed. Within 50 minutes the Foundation's operations engineer 873:
of anything. Perhaps they calculated it using a population weighted mean of availability rates by country, which would be an informative statistic, but then calling it an average would only characterize the method of derivation, not the nature of what the statistic purports to represent. The fraction
859:
refers to the spread of data. Here, a small number of advanced economies with very high penetration rates drag up the mean, but would not have touched the median. 30% is the mean average, which is not altogether appropriate here, as (I think) you acknowledge. The "even when" was a warning that 30% is
478:
project) that can be read by some offline readers. However, ongoing efforts focus mainly on the second half of the strategy: the provision of a good-quality reader capable of displaying off-line versions of wikis. A number of possible readers were tested. The "Kiwix" reader was selected in late 2010,
471:
While "dumps" are largely tried and tested (though recent work has focussed on improving their regularity and reliability), there have also been efforts to enable the export of smaller "collections" of articles, for example those relating to major health issues faced by developing countries. This was
939:
More direct citations would be more useful. To dig up *where* in the Factbook this could be found would take a bit of searching. "In 2010, however, only 30% of the world had any access at all to the so-called "World Wide Web", even when the high rates of availability found in the developed world are
793:
Downtime for the maintenance was well below a full hour. Also, planned maintenance does not count against the targeted downtime, as the targeted downtime is for unscheduled downtime (this is normal). That said, there have been a number of other outages that have put us past the 99.999% target, or
729: 620:
on the Foundation's "Software deployments" page to be expanded to all articles on the English Knowledge on 31 May. The lack of publicity given to the deployment raised criticism from some quarters, particularly in the light of recent controversies about the Pending Changes feature
172:
During the downtime, designed to allow the operations team sufficient time to "update the router software and tune the configuration", access to Wikimedia sites was intermittent. The episode and associated issues was alluded to by cartoonist Randall Monroe on his comic strip
110: 130: 636:
that the page was in error, and instead announced that the tool would be rolled out incrementally over the next few weeks. In related news, a fix preventing the tool from appearing on redirect pages was pushed live to Wikimedia sites (bug
100: 140: 479:
and the Foundation has since devoted time to improving its user interface, including via the translation of its interface. There is also competition from other readers, including "Okawix", the product of the French company Linterweb.
459:
There are two parts to the challenge: firstly, in ensuring that there are Wikipedias in as many languages as possible. The number of users for whom a Knowledge exists in a language they speak was recently estimated as above 98%
515: 892:
Well, it's my average: I took the sum of internet users and divided it by the size of the population. 30% of all the people in the world accessed the internet in 2010, that's the important point. -
837:
In 2010, however, only 30% of the world had any access at all to the so-called "World Wide Web", even when the high rates of availability found in the developed world are allowed to skew the data
518:
that some deletion debates and arbitration pages were being indexed on Google (that is to say, appeared in Google's search listings, despite this being prohibited by the English Knowledge's
959: 827: 813: 73: 744: 896: 864: 787: 557:. Instead, he advised that " use CC by-sa, CC-by or Public Domain ... If it's a software manual, license or dual-license it under the same licence as the software itself". 429: 416: 390: 377: 364: 351: 338: 306: 293: 267: 254: 241: 228: 215: 927: 918: 883: 713: 703: 120: 809:
Thanks for clarifying Ryan. I'd never have guessed that was standard practice. Does the Foundation have a target for limiting scheduled downtime too, do you know? -
656: 647: 166: 708: 949: 633: 803: 693: 575:
was updated, prompting a number of bug reports and some non-functionality during the transitionary period. It is now "gadget only", according to its developer
848: 777: 698: 686: 180: 680: 67: 52: 41: 617: 1026: 923:
To be fai, I don't even know why I used the word "average" in the first place...! Plain old "30% of the world" is more pithy anyway :P -
818:
I don't believe we have any targets listed for this. Obviously the ops team would like to have no scheduled downtime, and we rarely do.--
749: 626: 860:
not a useful metric for some uses because it hides the fact that some countries have very high rates but most have very low rates. -
756: 783:
The logged onwiki deletions are "child porn" and "kiddie porn image". The files were both deleted in June 2006. Does that help? -
160: 21: 622: 1001: 733: 996: 991: 546: 509:
Not all fixes may have gone live to WMF sites at the time of writing; some may not be scheduled to go live for many weeks.
986: 190: 974: 452:
Many Knowledge editors can now access the Internet from multiple locations: at home, at work, even on-the-go with
765:"office action"? "legal request"???? Is that all the explanation we will get for the deletion of those images? -- 487:
between the two. Which, if either, will become the standard is unclear, because it is such a fast-moving area.
583:). Many other Wikimedia wikis have their own copy of the tool; many of them will have to be updated manually. 981: 668: 46: 32: 17: 352:
MediaWiki 1.20wmf01 hits first WMF wiki, understanding 20% time, and why this report cannot yet be a draft
229:
MediaWiki 1.20wmf01 hits first WMF wiki, understanding 20% time, and why this report cannot yet be a draft
560:
Wikimedia developers honoured a request from the Foundation's legal department (one of what are termed "
945: 874:
of people who had access is not the same kind of thing as the mean amount of access each person had. ~
183:
for more details). Wikimedia developers enjoyed dissecting the technical aspects of the cartoon on the
823: 799: 561: 554: 538:) also began to add the directive to each page in turn to enforce non-spidering. Afterwards, bug # 461: 484: 638: 587: 539: 496: 941: 844: 1007: 819: 795: 772: 613: 465: 8: 914: 879: 535: 430:
What is: localisation?; the proposed "personal image filter" explained; and more in brief
307:
What is: localisation?; the proposed "personal image filter" explained; and more in brief
580: 184: 565: 527: 740: 609:
concerned one of the gadgets he has written for Wikimedia sites, "Commons Commander".
572: 840: 492: 766: 503: 956: 924: 910: 893: 875: 861: 810: 784: 630: 150: 1020: 576: 531: 530:
was working on the case, and NOINDEX code was added to relevant templates.
606: 453: 378:
The bugosphere, new mobile site and MediaWiki 1.18 close in on deployment
255:
The bugosphere, new mobile site and MediaWiki 1.18 close in on deployment
339:
Wikimedia Labs: soon to be at the cutting edge of MediaWiki development?
216:
Wikimedia Labs: soon to be at the cutting edge of MediaWiki development?
521: 598: 564:") to delete certain image files permanently from Wikimedia servers ( 480: 602: 594:
parser from rendering unusual but perfectly valid images, was fixed.
856: 154: 542:
was opened to propose automatically handling such cases in future.
902: 391:
Code Review backlog almost zero; What is: Subversion?; brief news
268:
Code Review backlog almost zero; What is: Subversion?; brief news
901:
Yes, that is the important point. It is not what is termed an "
474: 472:
in part provided by a new export format (ZIM, developed by the
869:
I read that as a statement of percentile threshold, not an
550: 464:); about 82% have a Knowledge in their native tongue (also 175: 591: 365:
What is: agile development? and new mobile site goes live
242:
What is: agile development? and new mobile site goes live
940:
allowed to skew the data (source: CIA World Factbook)."
404:
Wikimedia down for an hour; What is: Knowledge Offline?
281:
Wikimedia down for an hour; What is: Knowledge Offline?
68:
Wikimedia down for an hour; What is: Knowledge Offline?
597:
Magnus Manske, one of the original developers of the
754:If your comment has not appeared here, you can try 553:software licence recommended to developers by the 1018: 334: 148: 417:Bugs, Repairs, and Internal Operational News 294:Bugs, Repairs, and Internal Operational News 516:reported at the administrators' noticeboard 571:The codebase on the anti-vandalism tool 757: 14: 1019: 51: 1027:Knowledge Signpost archives 2011-05 27: 955:Country listing, under "World". - 667: 435: 422: 409: 396: 383: 370: 357: 344: 312: 299: 286: 273: 260: 247: 234: 221: 198: 53: 31: 28: 1038: 739:These comments are automatically 161:Wikimedia wikis down for an hour 135: 125: 115: 105: 95: 85: 167:last week's "Technology Report" 750:add the page to your watchlist 616:extension for rating articles 497:update on Wikimedia's progress 13: 1: 725: 18:Knowledge:Knowledge Signpost 7: 907:measure of central tendency 493:Wikimedia strategy document 403: 280: 191:What is: Knowledge Offline? 10: 1043: 794:even the 99.99% target. -- 960:18:03, 23 June 2011 (UTC) 950:17:48, 23 June 2011 (UTC) 514:On 26 May user MZMcBride 462:foundation-l mailing list 928:18:01, 2 June 2011 (UTC) 919:17:11, 2 June 2011 (UTC) 897:21:20, 1 June 2011 (UTC) 884:18:47, 1 June 2011 (UTC) 865:13:09, 1 June 2011 (UTC) 849:12:28, 1 June 2011 (UTC) 828:22:07, 2 June 2011 (UTC) 814:21:45, 31 May 2011 (UTC) 804:21:43, 31 May 2011 (UTC) 788:21:08, 31 May 2011 (UTC) 778:19:21, 31 May 2011 (UTC) 555:Free Software Foundation 545:David Gerard launched a 485:the differences he found 483:blogged last week about 185:wikitech-l mailing list 747:. To follow comments, 672: 590:, which prevented the 581:Technical Village Pump 203: 179:(see also this week's 36: 969:What do you think of 671: 660:"Technology report" → 579:(English Knowledge's 202: 35: 975:Share your feedback. 743:from this article's 652:"Technology report" 499:(as of March 2011). 734:Discuss this story 714:Arbitration report 704:WikiProject report 673: 204: 42:← Back to Contents 37: 758:purging the cache 719:Technology report 446: 445: 371:12 September 2011 248:12 September 2011 65:Technology report 47:View Latest Issue 1034: 1010: 942:Jodi.a.schneider 775: 769: 761: 759: 753: 732: 709:Featured content 691: 683: 676: 659: 651: 614:Article Feedback 601:software, began 566:server admin log 437: 424: 411: 398: 385: 372: 359: 346: 320: 319: 314: 301: 288: 275: 262: 249: 236: 223: 207: 206:Related articles 201: 157: 139: 138: 129: 128: 119: 118: 109: 108: 99: 98: 89: 88: 59: 57: 55: 1042: 1041: 1037: 1036: 1035: 1033: 1032: 1031: 1017: 1016: 1015: 1014: 1013: 1012: 1011: 1006: 1004: 999: 994: 989: 984: 977: 966: 965: 820:Ryan Lane (WMF) 796:Ryan Lane (WMF) 773: 767: 763: 755: 748: 737: 736: 730:+ Add a comment 728: 724: 723: 722: 684: 679: 677: 674: 663: 662: 657: 654: 649: 506: 449: 448: 447: 442: 211: 210: 205: 199: 194: 193: 163: 158: 147: 146: 145: 136: 126: 116: 106: 96: 86: 80: 77: 66: 62: 60: 50: 49: 44: 38: 26: 25: 24: 12: 11: 5: 1040: 1030: 1029: 1005: 1000: 995: 990: 985: 980: 979: 978: 968: 967: 964: 963: 962: 937: 936: 935: 934: 933: 932: 931: 930: 889: 888: 887: 886: 833: 832: 831: 830: 791: 790: 738: 735: 727: 726: 721: 716: 711: 706: 701: 696: 694:News and notes 690: 678: 666: 665: 664: 655: 646: 645: 644: 643: 642: 610: 607:first blogpost 595: 584: 569: 562:office actions 558: 543: 536:NuclearWarfare 534:(run by admin 505: 502: 450: 444: 443: 440: 439: 433: 427: 426: 420: 414: 413: 407: 401: 400: 394: 388: 387: 384:29 August 2011 381: 375: 374: 368: 362: 361: 355: 349: 348: 342: 335: 332: 331: 323: 317: 316: 310: 304: 303: 297: 291: 290: 284: 278: 277: 271: 265: 264: 261:29 August 2011 258: 252: 251: 245: 239: 238: 232: 226: 225: 219: 212: 208: 197: 196: 195: 192: 189: 162: 159: 144: 143: 133: 123: 113: 103: 93: 82: 81: 78: 72: 71: 70: 69: 64: 63: 61: 58: 45: 40: 39: 30: 29: 15: 9: 6: 4: 3: 2: 1039: 1028: 1025: 1024: 1022: 1009: 1003: 998: 993: 988: 983: 976: 972: 961: 958: 954: 953: 952: 951: 947: 943: 929: 926: 922: 921: 920: 916: 912: 908: 904: 900: 899: 898: 895: 891: 890: 885: 881: 877: 872: 868: 867: 866: 863: 858: 855: 854: 853: 852: 851: 850: 846: 842: 838: 829: 825: 821: 817: 816: 815: 812: 808: 807: 806: 805: 801: 797: 789: 786: 782: 781: 780: 779: 776: 770: 760: 751: 746: 742: 731: 720: 717: 715: 712: 710: 707: 705: 702: 700: 697: 695: 692: 688: 682: 675:In this issue 670: 661: 653: 640: 635: 632: 628: 624: 619: 615: 611: 608: 604: 600: 596: 593: 589: 585: 582: 578: 574: 570: 567: 563: 559: 556: 552: 548: 544: 541: 537: 533: 529: 525: 523: 517: 513: 512: 511: 510: 501: 500: 498: 494: 488: 486: 482: 477: 476: 469: 467: 463: 457: 455: 441: 438: 436:21 March 2011 432: 431: 425: 423:25 April 2011 419: 418: 412: 406: 405: 399: 393: 392: 386: 380: 379: 373: 367: 366: 360: 358:16 April 2012 354: 353: 347: 345:23 April 2012 341: 340: 333: 330: 329: 328: 327:More articles 322: 321: 318: 315: 313:21 March 2011 309: 308: 302: 300:25 April 2011 296: 295: 289: 283: 282: 276: 270: 269: 263: 257: 256: 250: 244: 243: 237: 235:16 April 2012 231: 230: 224: 222:23 April 2012 218: 217: 188: 186: 182: 181:"In the news" 178: 177: 170: 168: 156: 152: 142: 134: 132: 124: 122: 114: 112: 104: 102: 94: 92: 84: 83: 75: 56: 48: 43: 34: 23: 19: 971:The Signpost 970: 938: 906: 870: 836: 834: 792: 764: 718: 687:all comments 577:User:AzaToth 547:vocal attack 519: 508: 507: 490: 489: 473: 470: 466:foundation-l 458: 451: 434: 428: 421: 415: 408: 402: 397:18 July 2011 395: 389: 382: 376: 369: 363: 356: 350: 343: 337: 336: 326: 325: 324: 311: 305: 298: 292: 285: 279: 274:18 July 2011 272: 266: 259: 253: 246: 240: 233: 227: 220: 214: 213: 174: 171: 165:As noted in 164: 1008:Suggestions 841:Schneelocke 768:Orange Mike 741:transcluded 699:In the news 681:30 May 2011 631:Erik Möller 454:smartphones 410:30 May 2011 287:30 May 2011 209:What is...? 54:30 May 2011 618:was listed 603:a new blog 522:robots.txt 491:See also: 79:Share this 74:Contribute 22:2011-05-30 1002:Subscribe 957:Jarry1250 925:Jarry1250 911:Ningauble 894:Jarry1250 876:Ningauble 862:Jarry1250 811:Jarry1250 785:Jarry1250 745:talk page 634:explained 627:example 2 623:example 1 599:MediaWiki 528:Ryan Lane 481:User:Ziko 151:Jarry1250 1021:Category 997:Newsroom 992:Archives 857:Skewness 650:Previous 504:In brief 121:LinkedIn 101:Facebook 20:‎ | 903:average 871:average 573:Twinkle 549:on the 532:NukeBot 475:openZim 111:Twitter 905:", or 605:. His 131:Reddit 91:E-mail 987:About 639:29164 588:27465 586:Bug # 540:29162 16:< 982:Home 946:talk 915:talk 880:talk 845:talk 824:talk 800:talk 774:Talk 658:Next 612:The 551:GFDL 176:xkcd 153:and 141:Digg 771:| 629:). 592:SVG 155:FT2 149:By 76:— 1023:: 973:? 948:) 917:) 882:) 847:) 826:) 802:) 648:← 641:). 625:, 568:). 495:, 187:. 944:( 913:( 878:( 843:( 835:" 822:( 798:( 762:. 752:. 689:) 685:( 637:# 621:( 524:" 520:" 460:(

Index

Knowledge:Knowledge Signpost
2011-05-30
The Signpost
← Back to Contents
View Latest Issue
30 May 2011
Contribute
E-mail
Facebook
Twitter
LinkedIn
Reddit
Digg
Jarry1250
FT2
last week's "Technology Report"
xkcd
"In the news"
wikitech-l mailing list
Wikimedia Labs: soon to be at the cutting edge of MediaWiki development?
MediaWiki 1.20wmf01 hits first WMF wiki, understanding 20% time, and why this report cannot yet be a draft
What is: agile development? and new mobile site goes live
The bugosphere, new mobile site and MediaWiki 1.18 close in on deployment
Code Review backlog almost zero; What is: Subversion?; brief news
Wikimedia down for an hour; What is: Knowledge Offline?
Bugs, Repairs, and Internal Operational News
What is: localisation?; the proposed "personal image filter" explained; and more in brief
More articles
Wikimedia Labs: soon to be at the cutting edge of MediaWiki development?
MediaWiki 1.20wmf01 hits first WMF wiki, understanding 20% time, and why this report cannot yet be a draft

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.