Knowledge

:Knowledge Signpost/2023-12-04/In focus - Knowledge

Source 📝

117: 124: 144: 498: 104: 242: 254: 134: 36: 154: 114: 230: 387:— rather efficiently to begin with. But while database scans are good at finding articles containing specific DOI prefixes, they are bad at finding articles containing unflagged DOIs with these prefixes. Meaning that if, hypothetically, 92% of all articles with MDPI DOIs were flagged, you'd be wasting your processing power on 92% of articles with MDPI prefixes in them. As of writing, that's 164: 186: 730:
Those of us working on Cite Q, and on citation metadata on Wikidata, would have appreciated being informed of this initiative when it was being developed, in order that the functionality could be rolled out, and metadata updated (by a bot acting on DOI prefixes in exactly the same manner as described
917:
Assuming that all papers with a given DOI prefix are open access is not going to work well in practice, since many publishers have mixed approaches to making papers open access that have been published in their journals. I hope you've been automatically confirming this on a per-paper basis rather
573: 461:
makes it impossible to deal with it here, as well as the many other issues Citation bot is able to correct. Hopefully Wikidata people can look at the updates to the CS1 and CS2 templates and go through whatever is going on on their side of things and update things accordingly.
932:
These are specifically for registrants that have their entire portfolio in open access. MDPI, Frontiers Media, Hindawi, BioMed Central, Athabasca University Press, PeerJ, etc... When they have a mixed portfolio, like IOP Publishing, things don't get flagged.
157: 368: 402:. This is a category that specifically tracks if a citation has a) a known free DOI prefix and b) a DOI that has been flagged as free. As of writing, a bit over 16,000 Knowledge articles have been identified and processed. Here's an example edit: 127: 84: 167: 918:
than just relying on prefixes? Doing this work on Wikidata to start with (and focusing on data that can be individually checked by a script, rather than blanket automatic assumptions) would have been much better. Thanks.
147: 432: 214: 345:
greatly assisted in flagging free-to-read resources on select articles. However, OA Bot tends to be user-activated on specific articles, rather than systematically crawling every article on Knowledge.
717:
However, rather than adding metadata to multiple instances of the same citation, it's far more sensible to hold the data on Wikidata, and to render it as part of each citation from there - which is
764:
Well, consider yourself notified. I would have thought Wikidata people monitored CS1/2 talk pages so that cite Q can remain up to date, but that doesn't seem to have been the case. But also
391:— meaning well over 11,000 articles would be processed for nothing to catch the other ~1000. And the next time, if you have 98% flagged... you'll have an even more inefficient run. 90: 532: 197:. One change, in particular, goes a long way in flagging freely-available resources. Here's a short history of what was needed for the most recent changes to fully pay off. 552: 439:
The hope is to have the category mostly cleared by the end of December, when it will contain only new additions. Those should be easily handled by daily bot runs.
774:
and how it interacts with Wikidata is completely obscure (and we really should not be using it, ever), so no one involved expected it to throw errors like this.
557: 522: 588: 137: 527: 194: 515: 975: 509: 485: 476: 55: 44: 908: 883: 841: 816: 562: 395: 956: 927: 547: 542: 888:
The template that Cite Q wraps throws a maintenance message, because it was changed with no notification to the people who maintain Cite Q.
751: 1027: 372: 465:
It should be a relatively straightforward task for someone that understands how Wikidata works. That someone isn't me. But it could be
200: 789: 21: 593: 1003: 399: 998: 993: 600: 904: 837: 747: 348:
One way to find swathes of free DOIs is to identify DOI prefixes belonging to known open-access publishers. For example,
107: 988: 318: 296:
are for books, and usually point to individual academic papers published in peer-reviewed journals. Their structure is
577: 783:--[[--------------------------< B U I L D _ K N O W N _ F R E E _ D O I _ R E G I S T R A N T S _ T A B L E : --> 265: 30:
Tens of thousands of freely available sources flagged: Continuing years of efforts to improve free-to-read access.
943: 870: 803: 378: 466: 411: 821:
Cite Q, and its interactions with Wikidata, are extensively documented. It is not "throwing an error". HTH.
983: 497: 49: 35: 17: 388: 282: 308:, identifying who has registered the DOI in question. DOI registrants can be access platforms like 900: 833: 743: 415: 403: 649: 442: 337:
While the initial roll-out of DOI access locks was done manually and semi-automatically with
1009: 681: 8: 923: 662: 685: 447:
About 2 to 3% of the 16,000 or so articles seem to have a free DOI that is unflagged in
278:, were automatically rolled out. But the main identifier for scientific articles is the 939: 891: 866: 824: 799: 779:
Anyway, the current list of registrants can be gotten from the section that starts with
759: 734: 671: 648: 249:
conditions (e.g. free registration is required, only the first 5 reads are free, etc.)
699: 584: 365: 951: 878: 811: 706: 689: 854: 768: 721: 614: 455: 353: 342: 947: 919: 874: 807: 653: 433:
Proceedings of the National Academy of Sciences of the United States of America
423: 384: 1021: 935: 862: 795: 702: 338: 221: 177: 709: 676: 245:– to indicate a full version of a source that is freely accessible, with 233:– to indicate a full version of a source that is freely accessible, with 292:
For those unfamiliar with DOIs, they are roughly the equivalent of what
305: 694: 657: 371:. It worked pretty well for the big publishers, so an effort was made 448: 210: 206: 241: 427: 419: 407: 357: 349: 331: 323: 313: 289:
to signal whether or not a particular DOI link is free to read.
253: 451:, which are (mostly) the ones remaining in the category. Sadly, 270:
Access locks for always-free resources, like papers hosted on
309: 275: 271: 229: 193:
Over the weekend of 25 November, citation templates received
185: 224:
on visual appearance, things settled in the current scheme:
860:
doesn't mention what its equivalent Wikidata property is.
361: 327: 293: 205:
In October 2016, so-called "access locks" were deployed in
85:
Tens of thousands of freely available sources flagged
610:"a free DOI that is unflagged in Wikidata... Sadly, 598:If your comment has not appeared here, you can try 396:
recent update to the CS1 and CS2 citation templates
257:– to indicate a full version of a source that is 1019: 846:"throwing a maintenance message" then. As for 175: 383:Targeted Citation bot runs were done from 790:Module:Citation/CS1/Configuration/sandbox 693: 675: 620:makes it impossible to deal with it here" 373:to identify more open-access DOI prefixes 601: 375:, and the bot was updated accordingly. 261:(e.g. a paid subscription is required). 14: 1020: 400:Category:CS1 maint: unflagged free DOI 639:{{Cite Q|Q55893751 |doi-access=free}} 360:belongs to the equally controversial 54: 29: 364:. It's then a simple matter to have 1028:Knowledge Signpost archives 2023-12 201:Step 1: access locks get rolled out 27: 496: 319:Notre Dame Journal of Formal Logic 56: 34: 28: 1039: 583:These comments are automatically 285:, which requires the presence of 634:could be changed by the bot to: 252: 240: 228: 184: 162: 152: 142: 132: 122: 112: 102: 624:No, it does not; for example: 594:add the page to your watchlist 13: 1: 412:American Astronomical Society 957:23:42, 4 December 2023 (UTC) 928:21:37, 4 December 2023 (UTC) 909:21:43, 4 December 2023 (UTC) 884:21:31, 4 December 2023 (UTC) 842:21:24, 4 December 2023 (UTC) 817:21:18, 4 December 2023 (UTC) 752:16:39, 4 December 2023 (UTC) 569: 316:), individual journals like 18:Knowledge:Knowledge Signpost 7: 656:; et al. (8 October 2004). 10: 1044: 658:"The South Pole Telescope" 352:belongs to the (in)famous 326:), or publishers like the 266:Step 2: bots get involved 379:Step 3: search and flag 591:. To follow comments, 501: 398:, we have a solution: 39: 731:above), in parallel. 644:and would render as: 533:Disinformation report 500: 259:not freely accessible 38: 629:{{Cite Q|Q55893751}} 587:from this article's 686:2004SPIE.5498...11R 663:Proceedings of SPIE 652:; Peter A. R. Ade; 410:, belonging to the 68:File:Lock-green.svg 578:Discuss this story 502: 430:, associated with 422:, associated with 414:. Here's another: 394:Luckily, with the 45:← Back to Contents 40: 695:10.1117/12.552473 654:John E. Carlstrom 602:purging the cache 71:Trappist the monk 50:View Latest Issue 1035: 1012: 955: 907: 898: 894: 882: 859: 853: 849: 840: 831: 827: 815: 773: 767: 763: 750: 741: 737: 726: 720: 713: 697: 679: 677:astro-ph/0411122 640: 630: 619: 613: 605: 603: 597: 576: 553:Featured content 520: 512: 505: 488: 480: 460: 454: 303: 299: 288: 287:|doi-access=free 256: 244: 232: 188: 180: 166: 165: 156: 155: 146: 145: 136: 135: 126: 125: 116: 115: 106: 105: 62: 60: 58: 1043: 1042: 1038: 1037: 1036: 1034: 1033: 1032: 1018: 1017: 1016: 1015: 1014: 1013: 1008: 1006: 1001: 996: 991: 986: 979: 967: 966: 934: 896: 890: 889: 861: 857: 851: 847: 829: 823: 822: 794: 785: 771: 765: 757: 739: 733: 732: 724: 718: 638: 628: 617: 611: 607: 599: 592: 581: 580: 574:+ Add a comment 572: 568: 567: 566: 513: 510:4 December 2023 508: 506: 503: 492: 491: 486: 483: 478: 472: 471: 458: 452: 445: 416:flagging 4 DOIs 404:flagging 2 DOIs 389:12,151 articles 381: 354:Frontiers Media 304:part being the 301: 298:10.xxxxx/foobar 297: 286: 274:or papers with 268: 220:). After a few 213:templates (see 203: 189: 182: 181: 174: 173: 172: 163: 153: 143: 133: 123: 113: 103: 97: 94: 83: 79: 78: 75: 72: 69: 65: 63: 57:4 December 2023 53: 52: 47: 41: 31: 26: 25: 24: 12: 11: 5: 1041: 1031: 1030: 1007: 1002: 997: 992: 987: 982: 981: 980: 969: 968: 965: 964: 963: 962: 961: 960: 959: 915: 914: 913: 912: 911: 792: 782: 781: 780: 776: 775: 715: 714: 642: 641: 632: 631: 582: 579: 571: 570: 565: 560: 558:Traffic report 555: 550: 545: 540: 535: 530: 525: 523:News and notes 519: 507: 495: 494: 493: 484: 475: 474: 473: 444: 443:Where to next? 441: 426:journals, and 424:BioMed Central 418:with prefixes 385:database dumps 380: 377: 280:sometimes-free 267: 264: 263: 262: 250: 238: 202: 199: 191: 190: 183: 171: 170: 160: 150: 140: 130: 120: 110: 99: 98: 95: 89: 88: 87: 86: 81: 80: 76: 73: 70: 67: 66: 64: 61: 48: 43: 42: 33: 32: 15: 9: 6: 4: 3: 2: 1040: 1029: 1026: 1025: 1023: 1011: 1005: 1000: 995: 990: 985: 977: 973: 958: 953: 949: 945: 941: 937: 931: 930: 929: 925: 921: 916: 910: 906: 902: 897:Pigsonthewing 893: 887: 886: 885: 880: 876: 872: 868: 864: 856: 845: 844: 843: 839: 835: 830:Pigsonthewing 826: 820: 819: 818: 813: 809: 805: 801: 797: 793: 791: 787: 786: 778: 777: 770: 761: 760:Pigsonthewing 756: 755: 754: 753: 749: 745: 740:Pigsonthewing 736: 728: 723: 711: 708: 704: 701: 696: 691: 687: 683: 678: 673: 669: 665: 664: 659: 655: 651: 647: 646: 645: 637: 636: 635: 627: 626: 625: 622: 621: 616: 604: 595: 590: 586: 575: 564: 561: 559: 556: 554: 551: 549: 546: 544: 541: 539: 536: 534: 531: 529: 526: 524: 521: 517: 511: 504:In this issue 499: 490: 482: 470: 468: 463: 457: 450: 440: 437: 435: 434: 429: 425: 421: 417: 413: 409: 405: 401: 397: 392: 390: 386: 376: 374: 370: 367: 363: 359: 355: 351: 346: 344: 340: 335: 333: 329: 325: 321: 320: 315: 311: 307: 295: 290: 284: 281: 277: 273: 260: 255: 251: 248: 243: 239: 236: 231: 227: 226: 225: 223: 219: 217: 212: 208: 198: 196: 187: 179: 169: 161: 159: 151: 149: 141: 139: 131: 129: 121: 119: 111: 109: 101: 100: 92: 59: 51: 46: 37: 23: 19: 971: 905:Andy's edits 901:Talk to Andy 892:Andy Mabbett 848:|doi-access= 838:Andy's edits 834:Talk to Andy 825:Andy Mabbett 748:Andy's edits 744:Talk to Andy 735:Andy Mabbett 729: 727:'s purpose. 716: 667: 661: 643: 633: 623: 609: 608: 537: 528:In the media 516:all comments 489:"In focus" → 464: 446: 438: 431: 406:with prefix 393: 382: 366:Citation bot 347: 336: 317: 291: 279: 269: 258: 246: 234: 215: 204: 195:some updates 192: 108:PDF download 1010:Suggestions 585:transcluded 300:, with the 158:X (Twitter) 974:. You can 970:It's your 481:"In focus" 306:DOI prefix 237:conditions 96:Share this 91:Contribute 22:2023-12-04 1004:Subscribe 920:Mike Peel 710:Q55893751 703:0277-786X 670:: 11–29. 650:John Ruhl 589:talk page 369:flag them 1022:Category 999:Newsroom 994:Archives 972:Signpost 936:Headbomb 863:Headbomb 796:Headbomb 707:Wikidata 538:In focus 479:Previous 449:Wikidata 356:, while 302:10.xxxxx 218:coverage 216:Signpost 178:Headbomb 148:Facebook 138:LinkedIn 128:Mastodon 82:In focus 20:‎ | 976:help us 682:Bibcode 428:10.1073 420:10.1186 408:10.3847 358:10.3390 350:10.3389 332:10.1109 324:10.1305 314:10.2307 855:cite Q 769:cite Q 722:Cite Q 615:cite q 563:Humour 456:cite q 343:OA Bot 339:WP:AWB 276:PMCIDs 168:Reddit 118:E-mail 989:About 672:arXiv 548:Essay 543:Comix 310:JSTOR 294:ISBNs 272:arXiv 16:< 984:Home 924:talk 700:ISSN 668:5498 487:Next 362:MDPI 328:IEEE 247:some 222:RfCs 209:and 899:); 832:); 788:in 742:); 690:doi 467:you 334:). 283:DOI 211:CS2 207:CS1 176:By 93:— 1024:: 950:· 946:· 942:· 926:) 903:; 877:· 873:· 869:· 858:}} 852:{{ 850:, 836:; 810:· 806:· 802:· 784:-- 772:}} 766:{{ 746:; 725:}} 719:{{ 705:. 698:. 688:. 680:. 666:. 660:. 618:}} 612:{{ 477:← 469:! 459:}} 453:{{ 436:. 341:, 235:no 77:30 74:PD 978:. 954:} 952:b 948:p 944:c 940:t 938:{ 922:( 895:( 881:} 879:b 875:p 871:c 867:t 865:{ 828:( 814:} 812:b 808:p 804:c 800:t 798:{ 762:: 758:@ 738:( 712:. 692:: 684:: 674:: 606:. 596:. 518:) 514:( 330:( 322:( 312:(

Index

Knowledge:Knowledge Signpost
2023-12-04
The Signpost
← Back to Contents
View Latest Issue
4 December 2023
Contribute
PDF download
E-mail
Mastodon
LinkedIn
Facebook
X (Twitter)
Reddit
Headbomb

some updates
CS1
CS2
Signpost coverage
RfCs



arXiv
PMCIDs
DOI
ISBNs
DOI prefix
JSTOR

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.