Knowledge

Computational statistics

Source đź“ť

30: 110:) proposed making a distinction, defining 'statistical computing' as "the application of computer science to statistics", and 'computational statistics' as "aiming at the design of algorithm for implementing statistical methods on computers, including the ones unthinkable before the computer age (e.g. 176:. With the help of computational methods, he also has plots of the empirical distributions overlaid on the corresponding theoretical distributions. The computer has revolutionized simulation and has made the replication of Gosset’s experiment little more than an exercise. 361:
defined by an original sample of the population. It can be used to find a bootstrapped estimator of a population parameter. It can also be used to estimate the standard error of an estimator as well as to generate bootstrapped confidence intervals. The
210:
to perform simulations and other fundamental components in statistical analysis. One of the most well known of such devices is ERNIE, which produces random numbers that determine the winners of the
226:
of parameter estimates in samples under nonstandard conditions. This requires computers for practical implementations. To this point, computers have made many tedious statistical studies feasible.
1331: 161:
community. For the most part, the founders of the field of statistics relied on mathematics and asymptotic approximations in the development of computational statistical methodology.
480: 196: 493: 107: 445: 438: 1338: 729: 106:
The terms 'computational statistics' and 'statistical computing' are often used interchangeably, although Carlo Lauro (a former president of the
515: 431: 301:
problems and are most useful when it is difficult to use other approaches. Monte Carlo methods are mainly used in three problem classes:
505: 191:. One of the first efforts to generate random digits in a fully automated way, was undertaken by the RAND Corporation in 1947. The 1036:
Albert, J.H.; Gentle, J.E. (2004), Albert, James H; Gentle, James E (eds.), "Special Section: Teaching Computational Statistics",
1592: 1264: 1206: 1188: 1170: 1112: 900: 1561: 341:. The more steps are included, the more closely the distribution of the sample matches the actual desired distribution. 20: 157:
Though computational statistics is widely used today, it actually has a relatively short history of acceptance in the
1597: 1582: 1306: 1246: 1224: 1148: 1130: 1011: 743:
Trahan, Travis John (2019-10-03). Recent Advances in Monte Carlo Methods at Los Alamos National Laboratory (Report).
203: 184: 1301: 68:. This area is fast developing. The view that the broader concept of computing must be taught as part of general 1536: 452: 399: 358: 1459: 1439: 1324: 333:
proportional to a known function. These samples can be used to evaluate an integral over that variable, as its
239: 1497: 1464: 1444: 1368: 530: 417: 60:, and refers to the statistical methods that are enabled by using computational methods. It is the area of 29: 1587: 1388: 173: 1434: 1383: 354: 146: 142: 111: 38: 183:
deviates, performed methods to convert uniform deviates into other distributional forms using inverse
1551: 1541: 1474: 965:"A History of Distribution Sampling Prior to the Era of the Computer and its Relevance to Simulation" 877: 559: 520: 394: 384: 263: 255: 138: 96: 1487: 1449: 473: 424: 322: 310: 251: 188: 130: 1311: 525: 1556: 1515: 1510: 1482: 1454: 1398: 1373: 604:
Lauro, Carlo (1996), "Computational statistics or statistical computing, is that the question?",
126: 1505: 1378: 115: 1531: 1426: 1363: 1355: 1347: 723: 389: 379: 306: 247: 69: 61: 819:"A Short History of Markov Chain Monte Carlo: Subjective Recollections from Incomplete Data" 631: 1406: 1107:, Springer International Series in Operations Research & Management Science, Springer, 363: 290: 219: 165: 8: 1411: 1158: 678: 330: 259: 92: 1235: 1081: 1053: 906: 858: 830: 711: 659: 192: 169: 1416: 1260: 1242: 1220: 1202: 1184: 1166: 1144: 1126: 1108: 1057: 1007: 984: 945: 896: 850: 799: 791: 752: 663: 651: 617: 466: 267: 243: 964: 771: 1105:
Computational Probability: Algorithms and Applications in the Mathematical Sciences
1085: 1073: 1064:
Wilkinson, Leland (2008), "The Future of Statistical Computing (with discussion)",
1045: 980: 976: 937: 910: 888: 862: 840: 787: 783: 744: 703: 695: 643: 613: 554: 535: 404: 180: 134: 57: 326: 282: 202:
By the mid-1950s, several articles and patents for devices had been proposed for
121:
The term 'Computational statistics' may also be used to refer to computationally
941: 1100: 1077: 925: 334: 707: 1576: 988: 949: 892: 854: 795: 655: 578: 459: 803: 699: 647: 583:
Computational Statistics: A New Agenda for Statistical Theory and Practice.
510: 302: 211: 187:
or acceptance-rejection methods, and developed state-space methodology for
34: 1049: 298: 278: 1316: 676: 582: 715: 686: 557:& Temple Lang, D. (2010). "Computing in the Statistics Curricula", 286: 215: 207: 206:. The development of these devices were motivated from the need to use 158: 76: 65: 53: 845: 818: 756: 587: 179:
Later on, the scientists put forward computational ways of generating
1290:
Statistical Computing section of the American Statistical Association
84: 748: 338: 100: 88: 80: 1181:
Modeling with Data: Tools and Techniques for Statistical Computing
1165:, Wiley Series in Probability and Statistics, Wiley-Interscience, 835: 64:(or scientific computing) specific to the mathematical science of 294: 118:), as well as to cope with analytically intractable problems" . 1139:
Gentle, James E.; Härdle, Wolfgang; Mori, Yuichi, eds. (2004),
1289: 1284: 357:
is a resampling technique used to generate samples from an
223: 1141:
Handbook of Computational Statistics: Concepts and Methods
481:
Wiley Interdisciplinary Reviews: Computational Statistics
418:
Communications in Statistics - Simulation and Computation
1237:
Elements of Statistical Computing: Numerical Computation
214:, a lottery bond issued in the United Kingdom. In 1958, 410: 1307:
Journal of Computational & Graphical Statistics
1285:
International Association for Statistical Computing
875: 494:
International Association for Statistical Computing
285:to obtain numerical results. The concept is to use 108:
International Association for Statistical Computing
1257:Data Science: Scientific and Statistical Computing 1234: 1098: 817:Robert, Christian; Casella, George (2011-02-01). 636:Journal of Computational and Graphical Statistics 446:Journal of Statistical Computation and Simulation 439:Journal of Computational and Graphical Statistics 16:Interface between statistics and computer science 1574: 1138: 281:is a statistical method that relies on repeated 234: 969:Journal of the American Statistical Association 776:Journal of the American Statistical Association 222:was developed. It is as a method to reduce the 1103:; Glen, Andrew G.; Lemis, Lawrence M. (2007), 769: 516:Statistical methods in artificial intelligence 254:, given some observed data. It is achieved by 1332: 1156: 878:"History of uniform random number generation" 816: 588:Journal of the Washington Academy of Sciences 1302:Computational Statistics & Data Analysis 1035: 606:Computational Statistics & Data Analysis 432:Computational Statistics & Data Analysis 52:, is the study which is the intersection of 728:: CS1 maint: numeric names: authors list ( 316: 1339: 1325: 1219:, Springer Texts in Statistics, Springer, 923: 1346: 1214: 1063: 962: 844: 834: 506:Algorithms for statistical classification 325:method creates samples from a continuous 1217:Mathematical Statistics with Mathematica 28: 1254: 1232: 1196: 1178: 885:2017 Winter Simulation Conference (WSC) 770:Metropolis, Nicholas; Ulam, S. (1949). 199:, and also as a series of punch cards. 1575: 1215:Rose, Colin; Smith, Murray D. (2002), 1120: 742: 629: 1320: 603: 591:, vol. 78, no. 4, 1988, pp. 310–322. 293:in principle. They are often used in 273: 1123:Elements of Computational Statistics 574: 572: 266:is most probable under the assumed 33:Students working in the Statistics 13: 1024: 359:empirical probability distribution 172:which led to the discovery of the 14: 1609: 1278: 1273: 1001: 569: 411:Computational statistics journals 632:"Early Computational Statistics" 289:to solve problems that might be 185:cumulative distribution function 95:, such as cases with very large 1199:Numerical Methods of Statistics 995: 956: 917: 487: 453:Journal of Statistical Software 400:Computational materials science 373: 1233:Thisted, Ronald Aaron (1988), 1201:, Cambridge University Press, 1183:, Princeton University Press, 981:10.1080/01621459.1965.10480773 869: 810: 788:10.1080/01621459.1949.10483310 763: 736: 679:"The probable error of a mean" 670: 623: 597: 548: 526:List of statistical algorithms 309:, and generating draws from a 125:statistical methods including 1: 1593:Computational fields of study 926:"Notes on Bias in Estimation" 541: 240:Maximum likelihood estimation 235:Maximum likelihood estimation 195:produced were published as a 170:Monte Carlo method simulation 168:performed his now well-known 1004:Statistical Computing with R 618:10.1016/0167-9473(96)88920-1 531:List of statistical packages 7: 1295: 1029: 499: 147:generalized additive models 10: 1614: 1255:Gharieb, Reda. R. (2017), 1078:10.1198/004017008000000460 963:Teichroew, Daniel (1965). 924:QUENOUILLE, M. H. (1956). 229: 152: 143:artificial neural networks 39:London School of Economics 18: 1524: 1496: 1473: 1425: 1397: 1354: 1121:Gentle, James E. (2002), 1038:The American Statistician 942:10.1093/biomet/43.3-4.353 630:Watnik, Mitchell (2011). 560:The American Statistician 521:Free statistical software 395:Computational mathematics 385:Computational linguistics 139:kernel density estimation 79:the goal is to transform 1598:Mathematics of computing 1583:Computational statistics 1312:Statistics and Computing 1163:Computational Statistics 1092: 893:10.1109/WSC.2017.8247790 876:Pierre L'Ecuyer (2017). 772:"The Monte Carlo Method" 474:Statistics and Computing 425:Computational Statistics 323:Markov chain Monte Carlo 317:Markov chain Monte Carlo 311:probability distribution 252:probability distribution 204:random number generators 189:Markov chain Monte Carlo 174:Student’s t-distribution 131:Markov chain Monte Carlo 87:, but the focus lies on 46:Computational statistics 22:Computational Statistics 1562:Transportation science 1197:Monahan, John (2001), 648:10.1198/jcgs.2011.204b 366:is a related technique 77:traditional statistics 42: 1348:Computational science 1179:Klemens, Ben (2008), 1050:10.1198/0003130042872 390:Computational physics 380:Computational biology 307:numerical integration 72:is gaining momentum. 70:statistical education 62:computational science 50:statistical computing 32: 19:For the journal, see 1407:Electronic structure 1159:Hoeting, Jennifer A. 887:. pp. 202–230. 700:10.1093/biomet/6.1.1 166:William Sealy Gosset 99:and non-homogeneous 1412:Molecular mechanics 1259:, Noor Publishing, 823:Statistical Science 677:"Student" (1908). 331:probability density 260:likelihood function 93:statistical methods 1588:Numerical analysis 1369:Biological systems 708:10338.dmlcz/143545 274:Monte Carlo method 43: 1570: 1569: 1537:Materials science 1417:Quantum mechanics 1266:978-3-330-97256-8 1208:978-0-521-79168-7 1190:978-0-691-13314-0 1172:978-0-471-46124-1 1157:Givens, Geof H.; 1114:978-0-387-74675-3 902:978-1-5386-3428-8 846:10.1214/10-sts351 467:The Stata Journal 370: 367: 268:statistical model 1605: 1460:Particle physics 1440:Electromagnetics 1341: 1334: 1327: 1318: 1317: 1269: 1251: 1240: 1229: 1211: 1193: 1175: 1153: 1135: 1117: 1088: 1060: 1018: 1017: 999: 993: 992: 960: 954: 953: 936:(3–4): 353–360. 921: 915: 914: 882: 873: 867: 866: 848: 838: 814: 808: 807: 782:(247): 335–341. 767: 761: 760: 740: 734: 733: 727: 719: 683: 674: 668: 667: 627: 621: 620: 601: 595: 576: 567: 552: 536:Machine learning 405:Machine Learning 368: 352: 135:local regression 58:computer science 1613: 1612: 1608: 1607: 1606: 1604: 1603: 1602: 1573: 1572: 1571: 1566: 1520: 1492: 1469: 1421: 1393: 1350: 1345: 1298: 1281: 1276: 1267: 1249: 1227: 1209: 1191: 1173: 1151: 1133: 1115: 1101:Evans, Diane L. 1099:Drew, John H.; 1095: 1032: 1027: 1025:Further reading 1022: 1021: 1014: 1000: 996: 961: 957: 922: 918: 903: 880: 874: 870: 815: 811: 768: 764: 749:10.2172/1569710 741: 737: 721: 720: 681: 675: 671: 628: 624: 602: 598: 577: 570: 566:(2), pp.97-107. 553: 549: 544: 502: 490: 413: 376: 348: 344: 327:random variable 319: 283:random sampling 276: 237: 232: 155: 27: 17: 12: 11: 5: 1611: 1601: 1600: 1595: 1590: 1585: 1568: 1567: 1565: 1564: 1559: 1554: 1549: 1544: 1539: 1534: 1528: 1526: 1522: 1521: 1519: 1518: 1513: 1508: 1502: 1500: 1498:Social science 1494: 1493: 1491: 1490: 1485: 1479: 1477: 1471: 1470: 1468: 1467: 1465:Thermodynamics 1462: 1457: 1452: 1447: 1445:Fluid dynamics 1442: 1437: 1431: 1429: 1423: 1422: 1420: 1419: 1414: 1409: 1403: 1401: 1395: 1394: 1392: 1391: 1386: 1381: 1376: 1371: 1366: 1360: 1358: 1352: 1351: 1344: 1343: 1336: 1329: 1321: 1315: 1314: 1309: 1304: 1297: 1294: 1293: 1292: 1287: 1280: 1277: 1275: 1274:External links 1272: 1271: 1270: 1265: 1252: 1247: 1230: 1225: 1212: 1207: 1194: 1189: 1176: 1171: 1154: 1149: 1136: 1131: 1118: 1113: 1094: 1091: 1090: 1089: 1072:(4): 418–435, 1061: 1031: 1028: 1026: 1023: 1020: 1019: 1012: 1002:Rizzo, Maria. 994: 975:(309): 27–49. 955: 916: 901: 868: 809: 762: 735: 669: 642:(4): 811–817. 622: 612:(1): 191–193, 596: 579:Wegman, Edward 568: 546: 545: 543: 540: 539: 538: 533: 528: 523: 518: 513: 508: 501: 498: 497: 496: 489: 486: 485: 484: 477: 470: 463: 456: 449: 442: 435: 428: 421: 412: 409: 408: 407: 402: 397: 392: 387: 382: 375: 372: 346: 335:expected value 318: 315: 275: 272: 250:of an assumed 236: 233: 231: 228: 154: 151: 15: 9: 6: 4: 3: 2: 1610: 1599: 1596: 1594: 1591: 1589: 1586: 1584: 1581: 1580: 1578: 1563: 1560: 1558: 1555: 1553: 1550: 1548: 1545: 1543: 1540: 1538: 1535: 1533: 1530: 1529: 1527: 1523: 1517: 1514: 1512: 1509: 1507: 1504: 1503: 1501: 1499: 1495: 1489: 1486: 1484: 1481: 1480: 1478: 1476: 1472: 1466: 1463: 1461: 1458: 1456: 1453: 1451: 1448: 1446: 1443: 1441: 1438: 1436: 1433: 1432: 1430: 1428: 1424: 1418: 1415: 1413: 1410: 1408: 1405: 1404: 1402: 1400: 1396: 1390: 1389:Phylogenetics 1387: 1385: 1382: 1380: 1377: 1375: 1372: 1370: 1367: 1365: 1362: 1361: 1359: 1357: 1353: 1349: 1342: 1337: 1335: 1330: 1328: 1323: 1322: 1319: 1313: 1310: 1308: 1305: 1303: 1300: 1299: 1291: 1288: 1286: 1283: 1282: 1268: 1262: 1258: 1253: 1250: 1248:0-412-01371-1 1244: 1241:, CRC Press, 1239: 1238: 1231: 1228: 1226:0-387-95234-9 1222: 1218: 1213: 1210: 1204: 1200: 1195: 1192: 1186: 1182: 1177: 1174: 1168: 1164: 1160: 1155: 1152: 1150:3-540-40464-3 1146: 1142: 1137: 1134: 1132:0-387-95489-9 1128: 1124: 1119: 1116: 1110: 1106: 1102: 1097: 1096: 1087: 1083: 1079: 1075: 1071: 1067: 1066:Technometrics 1062: 1059: 1055: 1051: 1047: 1043: 1039: 1034: 1033: 1015: 1013:9781420010718 1009: 1005: 998: 990: 986: 982: 978: 974: 970: 966: 959: 951: 947: 943: 939: 935: 931: 927: 920: 912: 908: 904: 898: 894: 890: 886: 879: 872: 864: 860: 856: 852: 847: 842: 837: 832: 828: 824: 820: 813: 805: 801: 797: 793: 789: 785: 781: 777: 773: 766: 758: 754: 750: 746: 739: 731: 725: 717: 713: 709: 705: 701: 697: 693: 689: 688: 680: 673: 665: 661: 657: 653: 649: 645: 641: 637: 633: 626: 619: 615: 611: 607: 600: 594: 590: 589: 584: 580: 575: 573: 565: 562: 561: 556: 551: 547: 537: 534: 532: 529: 527: 524: 522: 519: 517: 514: 512: 509: 507: 504: 503: 495: 492: 491: 483: 482: 478: 476: 475: 471: 469: 468: 464: 462: 461: 460:The R Journal 457: 455: 454: 450: 448: 447: 443: 441: 440: 436: 434: 433: 429: 427: 426: 422: 420: 419: 415: 414: 406: 403: 401: 398: 396: 393: 391: 388: 386: 383: 381: 378: 377: 371: 365: 360: 356: 350: 349: 347:Bootstrapping 342: 340: 336: 332: 328: 324: 314: 312: 308: 304: 300: 296: 292: 291:deterministic 288: 284: 280: 271: 269: 265: 264:observed data 261: 257: 253: 249: 245: 241: 227: 225: 221: 217: 213: 209: 208:random digits 205: 200: 198: 194: 190: 186: 182: 181:pseudo-random 177: 175: 171: 167: 162: 160: 150: 148: 144: 140: 136: 132: 128: 124: 119: 117: 113: 109: 104: 102: 98: 94: 90: 86: 82: 78: 73: 71: 67: 63: 59: 55: 51: 47: 40: 36: 31: 25: 23: 1546: 1435:Astrophysics 1384:Neuroscience 1279:Associations 1256: 1236: 1216: 1198: 1180: 1162: 1143:, Springer, 1140: 1125:, Springer, 1122: 1104: 1069: 1065: 1041: 1037: 1003: 997: 972: 968: 958: 933: 929: 919: 884: 871: 826: 822: 812: 779: 775: 765: 738: 724:cite journal 691: 685: 672: 639: 635: 625: 609: 605: 599: 592: 586: 563: 558: 550: 511:Data science 488:Associations 479: 472: 465: 458: 451: 444: 437: 430: 423: 416: 374:Applications 351: 345: 343: 320: 303:optimization 299:mathematical 277: 262:so that the 238: 212:Premium Bond 201: 197:book in 1955 178: 163: 156: 122: 120: 105: 74: 49: 45: 44: 35:Machine Room 21: 1552:Engineering 1542:Mathematics 1475:Linguistics 694:(1): 1–25. 279:Monte Carlo 242:is used to 97:sample size 1577:Categories 1547:Statistics 1488:Lexicology 1450:Geophysics 930:Biometrika 687:Biometrika 542:References 287:randomness 256:maximizing 248:parameters 216:John Tukey 159:statistics 127:resampling 116:simulation 91:intensive 66:statistics 54:statistics 1557:Semiotics 1516:Economics 1511:Sociology 1483:Semantics 1455:Mechanics 1399:Chemistry 1374:Cognition 1058:219596225 989:0162-1459 950:0006-3444 855:0883-4237 836:0808.2902 796:0162-1459 664:120111510 656:1061-8600 555:Nolan, D. 364:jackknife 355:bootstrap 220:jackknife 164:In 1908, 133:methods, 129:methods, 123:intensive 112:bootstrap 101:data sets 85:knowledge 24:(journal) 1506:Politics 1379:Genomics 1296:Journals 1161:(2005), 1030:Articles 804:18139350 500:See also 339:variance 295:physical 244:estimate 89:computer 81:raw data 1532:Finance 1427:Physics 1364:Anatomy 1356:Biology 1086:3521989 911:4567651 863:2806098 757:1569710 716:2331554 329:, with 230:Methods 153:History 41:in 1964 37:of the 1263:  1245:  1223:  1205:  1187:  1169:  1147:  1129:  1111:  1084:  1056:  1010:  987:  948:  909:  899:  861:  853:  802:  794:  755:  714:  662:  654:  193:tables 75:As in 1525:Other 1093:Books 1082:S2CID 1054:S2CID 1044:: 1, 907:S2CID 881:(PDF) 859:S2CID 831:arXiv 829:(1). 712:JSTOR 682:(PDF) 660:S2CID 593:JSTOR 83:into 48:, or 1261:ISBN 1243:ISBN 1221:ISBN 1203:ISBN 1185:ISBN 1167:ISBN 1145:ISBN 1127:ISBN 1109:ISBN 1008:ISBN 985:ISSN 946:ISSN 897:ISBN 851:ISSN 800:PMID 792:ISSN 753:OSTI 730:link 652:ISSN 581:J. “ 353:The 321:The 297:and 246:the 224:bias 145:and 56:and 1074:doi 1046:doi 977:doi 938:doi 889:doi 841:doi 784:doi 745:doi 704:hdl 696:doi 644:doi 614:doi 337:or 218:’s 1579:: 1080:, 1070:50 1068:, 1052:, 1042:58 1040:, 1006:. 983:. 973:60 971:. 967:. 944:. 934:43 932:. 928:. 905:. 895:. 883:. 857:. 849:. 839:. 827:26 825:. 821:. 798:. 790:. 780:44 778:. 774:. 751:. 726:}} 722:{{ 710:. 702:. 690:. 684:. 658:. 650:. 640:20 638:. 634:. 610:23 608:, 585:” 571:^ 564:64 313:. 305:, 270:. 258:a 149:. 141:, 137:, 114:, 103:. 1340:e 1333:t 1326:v 1076:: 1048:: 1016:. 991:. 979:: 952:. 940:: 913:. 891:: 865:. 843:: 833:: 806:. 786:: 759:. 747:: 732:) 718:. 706:: 698:: 692:6 666:. 646:: 616:: 369:. 26:.

Index

Computational Statistics (journal)

Machine Room
London School of Economics
statistics
computer science
computational science
statistics
statistical education
traditional statistics
raw data
knowledge
computer
statistical methods
sample size
data sets
International Association for Statistical Computing
bootstrap
simulation
resampling
Markov chain Monte Carlo
local regression
kernel density estimation
artificial neural networks
generalized additive models
statistics
William Sealy Gosset
Monte Carlo method simulation
Student’s t-distribution
pseudo-random

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.

↑