Knowledge

Computational statistics

Source đź“ť

41: 121:) proposed making a distinction, defining 'statistical computing' as "the application of computer science to statistics", and 'computational statistics' as "aiming at the design of algorithm for implementing statistical methods on computers, including the ones unthinkable before the computer age (e.g. 187:. With the help of computational methods, he also has plots of the empirical distributions overlaid on the corresponding theoretical distributions. The computer has revolutionized simulation and has made the replication of Gosset’s experiment little more than an exercise. 372:
defined by an original sample of the population. It can be used to find a bootstrapped estimator of a population parameter. It can also be used to estimate the standard error of an estimator as well as to generate bootstrapped confidence intervals. The
221:
to perform simulations and other fundamental components in statistical analysis. One of the most well known of such devices is ERNIE, which produces random numbers that determine the winners of the
237:
of parameter estimates in samples under nonstandard conditions. This requires computers for practical implementations. To this point, computers have made many tedious statistical studies feasible.
1342: 172:
community. For the most part, the founders of the field of statistics relied on mathematics and asymptotic approximations in the development of computational statistical methodology.
491: 207: 504: 118: 456: 449: 1349: 740: 117:
The terms 'computational statistics' and 'statistical computing' are often used interchangeably, although Carlo Lauro (a former president of the
526: 442: 312:
problems and are most useful when it is difficult to use other approaches. Monte Carlo methods are mainly used in three problem classes:
516: 202:. One of the first efforts to generate random digits in a fully automated way, was undertaken by the RAND Corporation in 1947. The 1047:
Albert, J.H.; Gentle, J.E. (2004), Albert, James H; Gentle, James E (eds.), "Special Section: Teaching Computational Statistics",
1603: 1275: 1217: 1199: 1181: 1123: 911: 17: 1572: 352:. The more steps are included, the more closely the distribution of the sample matches the actual desired distribution. 31: 168:
Though computational statistics is widely used today, it actually has a relatively short history of acceptance in the
1608: 1593: 1317: 1257: 1235: 1159: 1141: 1022: 754:
Trahan, Travis John (2019-10-03). Recent Advances in Monte Carlo Methods at Los Alamos National Laboratory (Report).
214: 195: 1312: 79:. This area is fast developing. The view that the broader concept of computing must be taught as part of general 1547: 463: 410: 369: 1470: 1450: 1335: 344:
proportional to a known function. These samples can be used to evaluate an integral over that variable, as its
250: 1508: 1475: 1455: 1379: 541: 428: 71:, and refers to the statistical methods that are enabled by using computational methods. It is the area of 40: 1598: 1399: 184: 1445: 1394: 365: 157: 153: 122: 49: 194:
deviates, performed methods to convert uniform deviates into other distributional forms using inverse
1562: 1552: 1485: 976:"A History of Distribution Sampling Prior to the Era of the Computer and its Relevance to Simulation" 888: 570: 531: 405: 395: 274: 266: 149: 107: 1498: 1460: 484: 435: 333: 321: 262: 199: 141: 1322: 536: 1567: 1526: 1521: 1493: 1465: 1409: 1384: 615:
Lauro, Carlo (1996), "Computational statistics or statistical computing, is that the question?",
137: 1516: 1389: 126: 1542: 1437: 1374: 1366: 1358: 734: 400: 390: 317: 258: 80: 72: 830:"A Short History of Markov Chain Monte Carlo: Subjective Recollections from Incomplete Data" 642: 1417: 1118:, Springer International Series in Operations Research & Management Science, Springer, 374: 301: 230: 176: 8: 1422: 1169: 689: 341: 270: 103: 1246: 1092: 1064: 917: 869: 841: 722: 670: 203: 180: 1427: 1271: 1253: 1231: 1213: 1195: 1177: 1155: 1137: 1119: 1068: 1018: 995: 956: 907: 861: 810: 802: 763: 674: 662: 628: 477: 278: 254: 975: 782: 1116:
Computational Probability: Algorithms and Applications in the Mathematical Sciences
1096: 1084: 1075:
Wilkinson, Leland (2008), "The Future of Statistical Computing (with discussion)",
1056: 991: 987: 948: 921: 899: 873: 851: 798: 794: 755: 714: 706: 654: 624: 565: 546: 415: 191: 145: 68: 337: 293: 213:
By the mid-1950s, several articles and patents for devices had been proposed for
132:
The term 'Computational statistics' may also be used to refer to computationally
952: 1111: 1088: 936: 345: 718: 1587: 999: 960: 903: 865: 806: 666: 589: 470: 814: 710: 658: 594:
Computational Statistics: A New Agenda for Statistical Theory and Practice.
521: 313: 222: 198:
or acceptance-rejection methods, and developed state-space methodology for
45: 1060: 309: 289: 1327: 687: 593: 726: 697: 568:& Temple Lang, D. (2010). "Computing in the Statistics Curricula", 297: 226: 218: 217:. The development of these devices were motivated from the need to use 169: 87: 76: 64: 856: 829: 767: 598: 190:
Later on, the scientists put forward computational ways of generating
1301:
Statistical Computing section of the American Statistical Association
95: 759: 349: 111: 99: 91: 1192:
Modeling with Data: Tools and Techniques for Statistical Computing
1176:, Wiley Series in Probability and Statistics, Wiley-Interscience, 846: 75:(or scientific computing) specific to the mathematical science of 305: 129:), as well as to cope with analytically intractable problems" . 1150:
Gentle, James E.; Härdle, Wolfgang; Mori, Yuichi, eds. (2004),
1300: 1295: 368:
is a resampling technique used to generate samples from an
234: 1152:
Handbook of Computational Statistics: Concepts and Methods
492:
Wiley Interdisciplinary Reviews: Computational Statistics
429:
Communications in Statistics - Simulation and Computation
1248:
Elements of Statistical Computing: Numerical Computation
225:, a lottery bond issued in the United Kingdom. In 1958, 421: 1318:
Journal of Computational & Graphical Statistics
1296:
International Association for Statistical Computing
886: 505:
International Association for Statistical Computing
296:to obtain numerical results. The concept is to use 119:
International Association for Statistical Computing
1268:Data Science: Scientific and Statistical Computing 1245: 1109: 828:Robert, Christian; Casella, George (2011-02-01). 647:Journal of Computational and Graphical Statistics 457:Journal of Statistical Computation and Simulation 450:Journal of Computational and Graphical Statistics 27:Interface between statistics and computer science 1585: 1149: 292:is a statistical method that relies on repeated 245: 980:Journal of the American Statistical Association 787:Journal of the American Statistical Association 233:was developed. It is as a method to reduce the 1114:; Glen, Andrew G.; Lemis, Lawrence M. (2007), 780: 527:Statistical methods in artificial intelligence 265:, given some observed data. It is achieved by 1343: 1167: 889:"History of uniform random number generation" 827: 599:Journal of the Washington Academy of Sciences 1313:Computational Statistics & Data Analysis 1046: 617:Computational Statistics & Data Analysis 443:Computational Statistics & Data Analysis 63:, is the study which is the intersection of 739:: CS1 maint: numeric names: authors list ( 327: 1350: 1336: 1230:, Springer Texts in Statistics, Springer, 934: 1357: 1225: 1074: 973: 855: 845: 517:Algorithms for statistical classification 336:method creates samples from a continuous 1228:Mathematical Statistics with Mathematica 39: 1265: 1243: 1207: 1189: 896:2017 Winter Simulation Conference (WSC) 781:Metropolis, Nicholas; Ulam, S. (1949). 210:, and also as a series of punch cards. 14: 1586: 1226:Rose, Colin; Smith, Murray D. (2002), 1131: 753: 640: 1331: 614: 602:, vol. 78, no. 4, 1988, pp. 310–322. 304:in principle. They are often used in 284: 1134:Elements of Computational Statistics 585: 583: 277:is most probable under the assumed 44:Students working in the Statistics 24: 1035: 370:empirical probability distribution 183:which led to the discovery of the 25: 1620: 1289: 1284: 1012: 580: 422:Computational statistics journals 643:"Early Computational Statistics" 300:to solve problems that might be 196:cumulative distribution function 106:, such as cases with very large 1210:Numerical Methods of Statistics 1006: 967: 928: 498: 464:Journal of Statistical Software 411:Computational materials science 384: 1244:Thisted, Ronald Aaron (1988), 1212:, Cambridge University Press, 1194:, Princeton University Press, 992:10.1080/01621459.1965.10480773 880: 821: 799:10.1080/01621459.1949.10483310 774: 747: 690:"The probable error of a mean" 681: 634: 608: 559: 537:List of statistical algorithms 320:, and generating draws from a 136:statistical methods including 13: 1: 1604:Computational fields of study 937:"Notes on Bias in Estimation" 552: 251:Maximum likelihood estimation 246:Maximum likelihood estimation 206:produced were published as a 181:Monte Carlo method simulation 179:performed his now well-known 1015:Statistical Computing with R 629:10.1016/0167-9473(96)88920-1 542:List of statistical packages 7: 1306: 1040: 510: 158:generalized additive models 10: 1625: 1266:Gharieb, Reda. R. (2017), 1089:10.1198/004017008000000460 974:Teichroew, Daniel (1965). 935:QUENOUILLE, M. H. (1956). 240: 163: 154:artificial neural networks 50:London School of Economics 29: 1535: 1507: 1484: 1436: 1408: 1365: 1132:Gentle, James E. (2002), 1049:The American Statistician 953:10.1093/biomet/43.3-4.353 641:Watnik, Mitchell (2011). 571:The American Statistician 532:Free statistical software 406:Computational mathematics 396:Computational linguistics 150:kernel density estimation 90:the goal is to transform 1609:Mathematics of computing 1594:Computational statistics 1323:Statistics and Computing 1174:Computational Statistics 1103: 904:10.1109/WSC.2017.8247790 887:Pierre L'Ecuyer (2017). 783:"The Monte Carlo Method" 485:Statistics and Computing 436:Computational Statistics 334:Markov chain Monte Carlo 328:Markov chain Monte Carlo 322:probability distribution 263:probability distribution 215:random number generators 200:Markov chain Monte Carlo 185:Student’s t-distribution 142:Markov chain Monte Carlo 98:, but the focus lies on 57:Computational statistics 33:Computational Statistics 1573:Transportation science 1208:Monahan, John (2001), 659:10.1198/jcgs.2011.204b 377:is a related technique 88:traditional statistics 53: 1359:Computational science 1190:Klemens, Ben (2008), 1061:10.1198/0003130042872 401:Computational physics 391:Computational biology 318:numerical integration 83:is gaining momentum. 81:statistical education 73:computational science 61:statistical computing 43: 30:For the journal, see 18:Statistical computing 1418:Electronic structure 1170:Hoeting, Jennifer A. 898:. pp. 202–230. 711:10.1093/biomet/6.1.1 177:William Sealy Gosset 110:and non-homogeneous 1423:Molecular mechanics 1270:, Noor Publishing, 834:Statistical Science 688:"Student" (1908). 342:probability density 271:likelihood function 104:statistical methods 1599:Numerical analysis 1380:Biological systems 719:10338.dmlcz/143545 285:Monte Carlo method 54: 1581: 1580: 1548:Materials science 1428:Quantum mechanics 1277:978-3-330-97256-8 1219:978-0-521-79168-7 1201:978-0-691-13314-0 1183:978-0-471-46124-1 1168:Givens, Geof H.; 1125:978-0-387-74675-3 913:978-1-5386-3428-8 857:10.1214/10-sts351 478:The Stata Journal 381: 378: 279:statistical model 16:(Redirected from 1616: 1471:Particle physics 1451:Electromagnetics 1352: 1345: 1338: 1329: 1328: 1280: 1262: 1251: 1240: 1222: 1204: 1186: 1164: 1146: 1128: 1099: 1071: 1029: 1028: 1010: 1004: 1003: 971: 965: 964: 947:(3–4): 353–360. 932: 926: 925: 893: 884: 878: 877: 859: 849: 825: 819: 818: 793:(247): 335–341. 778: 772: 771: 751: 745: 744: 738: 730: 694: 685: 679: 678: 638: 632: 631: 612: 606: 587: 578: 563: 547:Machine learning 416:Machine Learning 379: 363: 146:local regression 69:computer science 21: 1624: 1623: 1619: 1618: 1617: 1615: 1614: 1613: 1584: 1583: 1582: 1577: 1531: 1503: 1480: 1432: 1404: 1361: 1356: 1309: 1292: 1287: 1278: 1260: 1238: 1220: 1202: 1184: 1162: 1144: 1126: 1112:Evans, Diane L. 1110:Drew, John H.; 1106: 1043: 1038: 1036:Further reading 1033: 1032: 1025: 1011: 1007: 972: 968: 933: 929: 914: 891: 885: 881: 826: 822: 779: 775: 760:10.2172/1569710 752: 748: 732: 731: 692: 686: 682: 639: 635: 613: 609: 588: 581: 577:(2), pp.97-107. 564: 560: 555: 513: 501: 424: 387: 359: 355: 338:random variable 330: 294:random sampling 287: 248: 243: 166: 38: 28: 23: 22: 15: 12: 11: 5: 1622: 1612: 1611: 1606: 1601: 1596: 1579: 1578: 1576: 1575: 1570: 1565: 1560: 1555: 1550: 1545: 1539: 1537: 1533: 1532: 1530: 1529: 1524: 1519: 1513: 1511: 1509:Social science 1505: 1504: 1502: 1501: 1496: 1490: 1488: 1482: 1481: 1479: 1478: 1476:Thermodynamics 1473: 1468: 1463: 1458: 1456:Fluid dynamics 1453: 1448: 1442: 1440: 1434: 1433: 1431: 1430: 1425: 1420: 1414: 1412: 1406: 1405: 1403: 1402: 1397: 1392: 1387: 1382: 1377: 1371: 1369: 1363: 1362: 1355: 1354: 1347: 1340: 1332: 1326: 1325: 1320: 1315: 1308: 1305: 1304: 1303: 1298: 1291: 1288: 1286: 1285:External links 1283: 1282: 1281: 1276: 1263: 1258: 1241: 1236: 1223: 1218: 1205: 1200: 1187: 1182: 1165: 1160: 1147: 1142: 1129: 1124: 1105: 1102: 1101: 1100: 1083:(4): 418–435, 1072: 1042: 1039: 1037: 1034: 1031: 1030: 1023: 1013:Rizzo, Maria. 1005: 986:(309): 27–49. 966: 927: 912: 879: 820: 773: 746: 680: 653:(4): 811–817. 633: 623:(1): 191–193, 607: 590:Wegman, Edward 579: 557: 556: 554: 551: 550: 549: 544: 539: 534: 529: 524: 519: 512: 509: 508: 507: 500: 497: 496: 495: 488: 481: 474: 467: 460: 453: 446: 439: 432: 423: 420: 419: 418: 413: 408: 403: 398: 393: 386: 383: 357: 346:expected value 329: 326: 286: 283: 261:of an assumed 247: 244: 242: 239: 165: 162: 26: 9: 6: 4: 3: 2: 1621: 1610: 1607: 1605: 1602: 1600: 1597: 1595: 1592: 1591: 1589: 1574: 1571: 1569: 1566: 1564: 1561: 1559: 1556: 1554: 1551: 1549: 1546: 1544: 1541: 1540: 1538: 1534: 1528: 1525: 1523: 1520: 1518: 1515: 1514: 1512: 1510: 1506: 1500: 1497: 1495: 1492: 1491: 1489: 1487: 1483: 1477: 1474: 1472: 1469: 1467: 1464: 1462: 1459: 1457: 1454: 1452: 1449: 1447: 1444: 1443: 1441: 1439: 1435: 1429: 1426: 1424: 1421: 1419: 1416: 1415: 1413: 1411: 1407: 1401: 1400:Phylogenetics 1398: 1396: 1393: 1391: 1388: 1386: 1383: 1381: 1378: 1376: 1373: 1372: 1370: 1368: 1364: 1360: 1353: 1348: 1346: 1341: 1339: 1334: 1333: 1330: 1324: 1321: 1319: 1316: 1314: 1311: 1310: 1302: 1299: 1297: 1294: 1293: 1279: 1273: 1269: 1264: 1261: 1259:0-412-01371-1 1255: 1252:, CRC Press, 1250: 1249: 1242: 1239: 1237:0-387-95234-9 1233: 1229: 1224: 1221: 1215: 1211: 1206: 1203: 1197: 1193: 1188: 1185: 1179: 1175: 1171: 1166: 1163: 1161:3-540-40464-3 1157: 1153: 1148: 1145: 1143:0-387-95489-9 1139: 1135: 1130: 1127: 1121: 1117: 1113: 1108: 1107: 1098: 1094: 1090: 1086: 1082: 1078: 1077:Technometrics 1073: 1070: 1066: 1062: 1058: 1054: 1050: 1045: 1044: 1026: 1024:9781420010718 1020: 1016: 1009: 1001: 997: 993: 989: 985: 981: 977: 970: 962: 958: 954: 950: 946: 942: 938: 931: 923: 919: 915: 909: 905: 901: 897: 890: 883: 875: 871: 867: 863: 858: 853: 848: 843: 839: 835: 831: 824: 816: 812: 808: 804: 800: 796: 792: 788: 784: 777: 769: 765: 761: 757: 750: 742: 736: 728: 724: 720: 716: 712: 708: 704: 700: 699: 691: 684: 676: 672: 668: 664: 660: 656: 652: 648: 644: 637: 630: 626: 622: 618: 611: 605: 601: 600: 595: 591: 586: 584: 576: 573: 572: 567: 562: 558: 548: 545: 543: 540: 538: 535: 533: 530: 528: 525: 523: 520: 518: 515: 514: 506: 503: 502: 494: 493: 489: 487: 486: 482: 480: 479: 475: 473: 472: 471:The R Journal 468: 466: 465: 461: 459: 458: 454: 452: 451: 447: 445: 444: 440: 438: 437: 433: 431: 430: 426: 425: 417: 414: 412: 409: 407: 404: 402: 399: 397: 394: 392: 389: 388: 382: 376: 371: 367: 361: 360: 358:Bootstrapping 353: 351: 347: 343: 339: 335: 325: 323: 319: 315: 311: 307: 303: 302:deterministic 299: 295: 291: 282: 280: 276: 275:observed data 272: 268: 264: 260: 256: 252: 238: 236: 232: 228: 224: 220: 219:random digits 216: 211: 209: 205: 201: 197: 193: 192:pseudo-random 188: 186: 182: 178: 173: 171: 161: 159: 155: 151: 147: 143: 139: 135: 130: 128: 124: 120: 115: 113: 109: 105: 101: 97: 93: 89: 84: 82: 78: 74: 70: 66: 62: 58: 51: 47: 42: 36: 34: 19: 1557: 1446:Astrophysics 1395:Neuroscience 1290:Associations 1267: 1247: 1227: 1209: 1191: 1173: 1154:, Springer, 1151: 1136:, Springer, 1133: 1115: 1080: 1076: 1052: 1048: 1014: 1008: 983: 979: 969: 944: 940: 930: 895: 882: 837: 833: 823: 790: 786: 776: 749: 735:cite journal 702: 696: 683: 650: 646: 636: 620: 616: 610: 603: 597: 574: 569: 561: 522:Data science 499:Associations 490: 483: 476: 469: 462: 455: 448: 441: 434: 427: 385:Applications 362: 356: 354: 331: 314:optimization 310:mathematical 288: 273:so that the 249: 223:Premium Bond 212: 208:book in 1955 189: 174: 167: 133: 131: 116: 85: 60: 56: 55: 46:Machine Room 32: 1563:Engineering 1553:Mathematics 1486:Linguistics 705:(1): 1–25. 290:Monte Carlo 253:is used to 108:sample size 1588:Categories 1558:Statistics 1499:Lexicology 1461:Geophysics 941:Biometrika 698:Biometrika 553:References 298:randomness 267:maximizing 259:parameters 227:John Tukey 170:statistics 138:resampling 127:simulation 102:intensive 77:statistics 65:statistics 1568:Semiotics 1527:Economics 1522:Sociology 1494:Semantics 1466:Mechanics 1410:Chemistry 1385:Cognition 1069:219596225 1000:0162-1459 961:0006-3444 866:0883-4237 847:0808.2902 807:0162-1459 675:120111510 667:1061-8600 566:Nolan, D. 375:jackknife 366:bootstrap 231:jackknife 175:In 1908, 144:methods, 140:methods, 134:intensive 123:bootstrap 112:data sets 96:knowledge 35:(journal) 1517:Politics 1390:Genomics 1307:Journals 1172:(2005), 1041:Articles 815:18139350 511:See also 350:variance 306:physical 255:estimate 100:computer 92:raw data 1543:Finance 1438:Physics 1375:Anatomy 1367:Biology 1097:3521989 922:4567651 874:2806098 768:1569710 727:2331554 340:, with 241:Methods 164:History 52:in 1964 48:of the 1274:  1256:  1234:  1216:  1198:  1180:  1158:  1140:  1122:  1095:  1067:  1021:  998:  959:  920:  910:  872:  864:  813:  805:  766:  725:  673:  665:  204:tables 86:As in 1536:Other 1104:Books 1093:S2CID 1065:S2CID 1055:: 1, 918:S2CID 892:(PDF) 870:S2CID 842:arXiv 840:(1). 723:JSTOR 693:(PDF) 671:S2CID 604:JSTOR 94:into 59:, or 1272:ISBN 1254:ISBN 1232:ISBN 1214:ISBN 1196:ISBN 1178:ISBN 1156:ISBN 1138:ISBN 1120:ISBN 1019:ISBN 996:ISSN 957:ISSN 908:ISBN 862:ISSN 811:PMID 803:ISSN 764:OSTI 741:link 663:ISSN 592:J. “ 364:The 332:The 308:and 257:the 235:bias 156:and 67:and 1085:doi 1057:doi 988:doi 949:doi 900:doi 852:doi 795:doi 756:doi 715:hdl 707:doi 655:doi 625:doi 348:or 229:’s 1590:: 1091:, 1081:50 1079:, 1063:, 1053:58 1051:, 1017:. 994:. 984:60 982:. 978:. 955:. 945:43 943:. 939:. 916:. 906:. 894:. 868:. 860:. 850:. 838:26 836:. 832:. 809:. 801:. 791:44 789:. 785:. 762:. 737:}} 733:{{ 721:. 713:. 701:. 695:. 669:. 661:. 651:20 649:. 645:. 621:23 619:, 596:” 582:^ 575:64 324:. 316:, 281:. 269:a 160:. 152:, 148:, 125:, 114:. 1351:e 1344:t 1337:v 1087:: 1059:: 1027:. 1002:. 990:: 963:. 951:: 924:. 902:: 876:. 854:: 844:: 817:. 797:: 770:. 758:: 743:) 729:. 717:: 709:: 703:6 677:. 657:: 627:: 380:. 37:. 20:)

Index

Statistical computing
Computational Statistics (journal)

Machine Room
London School of Economics
statistics
computer science
computational science
statistics
statistical education
traditional statistics
raw data
knowledge
computer
statistical methods
sample size
data sets
International Association for Statistical Computing
bootstrap
simulation
resampling
Markov chain Monte Carlo
local regression
kernel density estimation
artificial neural networks
generalized additive models
statistics
William Sealy Gosset
Monte Carlo method simulation
Student’s t-distribution

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.

↑