Knowledge

Binary regression

Source đź“ť

391: 929: 827:, which models the probability itself as a linear function of the explanatory variables. A drawback of the linear probability model is that, for some values of the explanatory variables, the model will predict probabilities less than zero or greater than one. 860:
For a detailed example, refer to: Tetsuo Yai, Seiji Iwakura, Shigeru Morichi, Multinomial probit with structured covariance for route choice behavior, Transportation Research Part B: Methodological, Volume 31, Issue 3, June 1997, Pages 195–207, ISSN
668: 700: 782: 758:
is a vector of variables which can affect the cash flow of this program. Then the manager will invest only when she expects the net discounted cash flow to be positive.
748: 623: 489: 723:
This model can be applied in many economic contexts. For instance, the outcome can be the decision of a manager whether invest to a program,
970: 421: 331: 893: 321: 454:. Generally the probability of the two alternatives is modeled, instead of simply outputting a single value, as in 285: 336: 274: 94: 69: 631: 836: 196: 673: 963: 812:
as a linear function of the explanatory variable or variables. The logit model is "simplest" in the sense of
155: 994: 414: 357: 326: 295: 222: 989: 559:, where normal variance and a cutoff are assumed. The latent variable interpretation is also used in 527:
between the explanatory variables and the output. In economics, binary regressions are used to model
316: 305: 269: 176: 543:, together with a measurement model; or as probabilistic models, directly modeling the probability. 956: 824: 813: 717: 377: 248: 171: 64: 43: 767: 407: 300: 264: 259: 201: 914: 881: 709: 540: 520: 352: 48: 906: 491:), and one of the two alternatives considered as "success" and coded as 1: the value is the 944: 762: 751: 726: 560: 447: 372: 362: 243: 211: 166: 145: 53: 8: 785: 580: 500: 495:
of successes in 1 trial, either 0 or 1. The most common binary regression models are the
468: 462: 439: 290: 191: 186: 140: 89: 79: 24: 817: 395: 124: 109: 907: 889: 508: 455: 390: 181: 38: 928: 820:
of the Bernoulli distribution, and thus it is the simplest to use for computations.
841: 206: 135: 886:
Regression Models for Categorical Dependent Variables Using Stata, Second Edition
451: 367: 74: 940: 119: 983: 528: 238: 114: 793: 556: 504: 104: 805: 524: 496: 150: 99: 936: 905:
Agresti, Alan (2007). "3.2 Generalized Linear Models for Binary Data".
870:
Bliss, C. I. (1934). "The Method of Probits". Science 79 (2037): 38–39.
492: 435: 566:
Formally, the latent variable interpretation posits that the outcome
809: 552: 551:
The latent variable interpretation has traditionally been used in
519:
Binary regression is principally applied either for prediction (
461:
Binary regression is usually analyzed as a special case of
882:"4. Models for binary outcomes: 4.1 The statistical model" 816:(GLIM): the log-odds are the natural parameter for the 770: 729: 676: 634: 583: 471: 776: 742: 694: 662: 617: 483: 981: 570:is related to a vector of explanatory variables 804:The simplest direct probabilistic model is the 539:Binary regression models can be interpreted as 964: 446:estimates a relationship between one or more 415: 837:Generalized linear model § Binary data 971: 957: 879: 823:Another direct probabilistic model is the 663:{\displaystyle y^{*}=x\beta +\varepsilon } 422: 408: 788:conditional on the explanatory variables 695:{\displaystyle \varepsilon \mid x\sim G} 546: 904: 880:Long, J. Scott; Freese, Jeremy (2006). 982: 799: 923: 13: 534: 14: 1006: 888:. Stata Press. pp. 131–136. 927: 389: 514: 337:Least-squares spectral analysis 275:Generalized estimating equation 95:Multinomial logistic regression 70:Vector generalized linear model 864: 854: 792:. This generates the standard 612: 593: 1: 847: 156:Nonlinear mixed-effects model 943:. You can help Knowledge by 777:{\displaystyle \varepsilon } 7: 830: 358:Mean and predicted response 10: 1011: 922: 151:Linear mixed-effects model 913:(2nd ed.). pp.  909:Categorical Data Analysis 814:generalized linear models 523:), or for estimating the 465:, with a single outcome ( 317:Least absolute deviations 825:linear probability model 718:probability distribution 65:Generalized linear model 784:is assumed to follow a 939:-related article is a 778: 744: 696: 664: 619: 541:latent variable models 485: 396:Mathematics portal 322:Iteratively reweighted 779: 745: 743:{\displaystyle y^{*}} 697: 665: 620: 547:Latent variable model 521:binary classification 486: 448:explanatory variables 353:Regression validation 332:Bayesian multivariate 49:Polynomial regression 768: 752:discounted cash flow 750:is the expected net 727: 674: 632: 581: 561:item response theory 469: 450:and a single output 378:Gauss–Markov theorem 373:Studentized residual 363:Errors and residuals 197:Principal components 167:Nonlinear regression 54:General linear model 995:Regression analysis 808:, which models the 800:Probabilistic model 786:normal distribution 618:{\displaystyle y=1} 501:logistic regression 484:{\displaystyle n=1} 463:binomial regression 440:regression analysis 223:Errors-in-variables 90:Logistic regression 80:Binomial regression 25:Regression analysis 19:Part of a series on 818:exponential family 774: 740: 692: 660: 615: 481: 110:Multinomial probit 952: 951: 509:probit regression 456:linear regression 444:binary regression 432: 431: 85:Binary regression 44:Simple regression 39:Linear regression 1002: 990:Statistics stubs 973: 966: 959: 931: 924: 918: 912: 899: 895:978-1-59718011-5 871: 868: 862: 858: 842:Fractional model 783: 781: 780: 775: 749: 747: 746: 741: 739: 738: 707: 701: 699: 698: 693: 669: 667: 666: 661: 644: 643: 624: 622: 621: 616: 605: 604: 490: 488: 487: 482: 424: 417: 410: 394: 393: 301:Ridge regression 136:Multilevel model 16: 15: 1010: 1009: 1005: 1004: 1003: 1001: 1000: 999: 980: 979: 978: 977: 921: 896: 875: 874: 869: 865: 859: 855: 850: 833: 802: 769: 766: 765: 734: 730: 728: 725: 724: 708:is a vector of 703: 675: 672: 671: 639: 635: 633: 630: 629: 600: 596: 582: 579: 578: 555:, yielding the 549: 537: 535:Interpretations 517: 470: 467: 466: 452:binary variable 438:, specifically 428: 388: 368:Goodness of fit 75:Discrete choice 12: 11: 5: 1008: 998: 997: 992: 976: 975: 968: 961: 953: 950: 949: 932: 920: 919: 901: 900: 894: 876: 873: 872: 863: 852: 851: 849: 846: 845: 844: 839: 832: 829: 801: 798: 773: 737: 733: 691: 688: 685: 682: 679: 659: 656: 653: 650: 647: 642: 638: 626: 625: 614: 611: 608: 603: 599: 595: 592: 589: 586: 548: 545: 536: 533: 516: 513: 480: 477: 474: 430: 429: 427: 426: 419: 412: 404: 401: 400: 399: 398: 383: 382: 381: 380: 375: 370: 365: 360: 355: 347: 346: 342: 341: 340: 339: 334: 329: 324: 319: 311: 310: 309: 308: 303: 298: 293: 288: 280: 279: 278: 277: 272: 267: 262: 254: 253: 252: 251: 246: 241: 233: 232: 228: 227: 226: 225: 217: 216: 215: 214: 209: 204: 199: 194: 189: 184: 179: 177:Semiparametric 174: 169: 161: 160: 159: 158: 153: 148: 146:Random effects 143: 138: 130: 129: 128: 127: 122: 120:Ordered probit 117: 112: 107: 102: 97: 92: 87: 82: 77: 72: 67: 59: 58: 57: 56: 51: 46: 41: 33: 32: 28: 27: 21: 20: 9: 6: 4: 3: 2: 1007: 996: 993: 991: 988: 987: 985: 974: 969: 967: 962: 960: 955: 954: 948: 946: 942: 938: 933: 930: 926: 925: 916: 911: 910: 903: 902: 897: 891: 887: 883: 878: 877: 867: 857: 853: 843: 840: 838: 835: 834: 828: 826: 821: 819: 815: 811: 807: 797: 795: 791: 787: 771: 764: 759: 757: 753: 735: 731: 721: 719: 715: 711: 706: 689: 686: 683: 680: 677: 657: 654: 651: 648: 645: 640: 636: 609: 606: 601: 597: 590: 587: 584: 577: 576: 575: 573: 569: 564: 562: 558: 554: 544: 542: 532: 530: 529:binary choice 526: 522: 512: 510: 506: 502: 498: 494: 478: 475: 472: 464: 459: 457: 453: 449: 445: 441: 437: 425: 420: 418: 413: 411: 406: 405: 403: 402: 397: 392: 387: 386: 385: 384: 379: 376: 374: 371: 369: 366: 364: 361: 359: 356: 354: 351: 350: 349: 348: 344: 343: 338: 335: 333: 330: 328: 325: 323: 320: 318: 315: 314: 313: 312: 307: 304: 302: 299: 297: 294: 292: 289: 287: 284: 283: 282: 281: 276: 273: 271: 268: 266: 263: 261: 258: 257: 256: 255: 250: 247: 245: 242: 240: 239:Least squares 237: 236: 235: 234: 230: 229: 224: 221: 220: 219: 218: 213: 210: 208: 205: 203: 200: 198: 195: 193: 190: 188: 185: 183: 180: 178: 175: 173: 172:Nonparametric 170: 168: 165: 164: 163: 162: 157: 154: 152: 149: 147: 144: 142: 141:Fixed effects 139: 137: 134: 133: 132: 131: 126: 123: 121: 118: 116: 115:Ordered logit 113: 111: 108: 106: 103: 101: 98: 96: 93: 91: 88: 86: 83: 81: 78: 76: 73: 71: 68: 66: 63: 62: 61: 60: 55: 52: 50: 47: 45: 42: 40: 37: 36: 35: 34: 30: 29: 26: 23: 22: 18: 17: 945:expanding it 934: 908: 885: 866: 856: 822: 803: 794:probit model 789: 760: 755: 722: 713: 704: 627: 571: 567: 565: 557:probit model 550: 538: 518: 515:Applications 505:probit model 460: 443: 433: 296:Non-negative 84: 806:logit model 761:Often, the 525:association 497:logit model 306:Regularized 270:Generalized 202:Least angle 100:Mixed logit 984:Categories 937:statistics 848:References 763:error term 710:parameters 503:) and the 436:statistics 345:Background 249:Non-linear 231:Estimation 861:0191-2615 772:ε 736:∗ 687:∼ 681:∣ 678:ε 658:ε 652:β 641:∗ 602:∗ 212:Segmented 831:See also 810:log-odds 553:bioassay 327:Bayesian 265:Weighted 260:Ordinary 192:Isotonic 187:Quantile 563:(IRT). 286:Partial 125:Poisson 892:  705:β 628:where 244:Linear 182:Robust 105:Probit 31:Models 935:This 716:is a 493:count 291:Total 207:Local 941:stub 917:–73. 890:ISBN 754:and 712:and 670:and 607:> 442:, a 574:by 511:). 434:In 986:: 915:68 884:. 796:. 720:. 702:, 531:. 458:. 972:e 965:t 958:v 947:. 898:. 790:x 756:x 732:y 714:G 690:G 684:x 655:+ 649:x 646:= 637:y 613:] 610:0 598:y 594:[ 591:1 588:= 585:y 572:x 568:y 507:( 499:( 479:1 476:= 473:n 423:e 416:t 409:v

Index

Regression analysis
Linear regression
Simple regression
Polynomial regression
General linear model
Generalized linear model
Vector generalized linear model
Discrete choice
Binomial regression
Binary regression
Logistic regression
Multinomial logistic regression
Mixed logit
Probit
Multinomial probit
Ordered logit
Ordered probit
Poisson
Multilevel model
Fixed effects
Random effects
Linear mixed-effects model
Nonlinear mixed-effects model
Nonlinear regression
Nonparametric
Semiparametric
Robust
Quantile
Isotonic
Principal components

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.

↑