Knowledge

Panel data

Source đź“ť

387:) example above, two datasets with a panel structure are shown and the objective is to test whether there's a significant difference between people in the sample data. Individual characteristics (income, age, sex) are collected for different persons and different years. In the first dataset, two persons (1, 2) are observed every year for three years (2016, 2017, 2018). In the second dataset, three persons (1, 2, 3) are observed two times (person 1), three times (person 2), and one time (person 3), respectively, over three years (2016, 2017, 2018); in particular, person 1 is not observed in year 2018 and person 3 is not observed in 2016 or 2018. 25: 112:
source of information in the mathematical and statistical sciences. CPD stands out from other research methods because it vividly illustrates how independent and dependent variables may shift between countries. This panel data collection allows researchers to examine the connection between variables across several cross-sections and time periods and analyze the results of policy actions in other nations.
111:
can be thought of as special cases of panel data that are in one dimension only (one panel member or individual for the former, one time point for the latter). A literature search often involves time series, cross-sectional, or panel data. Cross-panel data (CPD) is an innovative yet underappreciated
1144:
is fixed over time, it will induce serial correlation in the error term of the regression. This means that more efficient estimation techniques are available. Random effects is one such method: it is a special case of feasible
1293: 1333:
is believed to be correlated with one of the independent variables, an alternative estimation technique must be used. Instrumental variables or GMM techniques are commonly used in this situation, such as the
1116:
is not correlated with any of the independent variables, ordinary least squares linear regression methods can be used to yield unbiased and consistent estimates of the regression parameters. However, because
710: 922: 829: 612:
points in time (for the example, the wide format would have only two (first example) or three (second example) rows of data with additional columns for each time-varying variable (income, age).
987: 595: 1299: 492: 1676: 1174: 1142: 1114: 1076: 1016: 1356: 1046: 1331: 753: 733: 563: 543: 523: 460: 440: 420: 1018:
are individual-specific, time-invariant effects (e.g., in a panel of countries this could include geography, climate, etc.) which are fixed over time, whereas
1194: 1368: 1306:
may occur. The fixed effect estimator and the first differences estimator both rely on the assumption of strict exogeneity. Hence, if
101:
involving measurements over time. Panel data is a subset of longitudinal data where observations are for the same subjects each time.
1078:
is unobserved, and correlated with at least one of the independent variables, then it will cause omitted variable bias in a standard
632: 1565:
Davies, A.; Lahiri, K. (2000). "Re-examining the Rational Expectations Hypothesis Using Panel Data on Multi-Period Forecasts".
1532: 1641: 1542:
Davies, A.; Lahiri, K. (1995). "A New Framework for Testing Rationality and Measuring Aggregate Shocks Using Panel Data".
848: 758: 1646: 1666: 1615: 1593: 1574: 1472: 1447: 68: 46: 39: 1671: 831:. Different assumptions can be made on the precise structure of this general model. Two important models are the 1380: 1362: 1392: 930: 604:, which is where one row holds one observation per time. Another way to structure panel data would be the 1411: 1335: 1386: 1303: 1083: 1146: 1082:
regression. However, panel data methods, such as the fixed effects estimator or alternatively, the
568: 33: 1439: 1544: 1338:. While estimating this we should have the proper information about the instrumental variables. 465: 1079: 50: 1152: 1120: 1092: 1054: 994: 1431: 1021: 1350: 1309: 836: 108: 8: 1661: 1432: 1398: 832: 738: 718: 548: 528: 508: 445: 425: 405: 116: 505:
panel member is not observed every period. Therefore, if an unbalanced panel contains
1611: 1589: 1570: 1557: 1528: 1468: 1443: 545:
periods, then the following strict inequality holds for the number of observations (
1553: 1501: 621: 1430:
Diggle, Peter J.; Heagerty, Patrick; Liang, Kung-Yee; Zeger, Scott L. (2002).
1655: 1586:
Longitudinal and Panel Data: Analysis and Applications in the Social Sciences
1505: 1185: 755:
is the time dimension. A general panel data regression model is written as
86: 1603: 104: 1405: 82: 1149:
which controls for the structure of the serial correlation induced by
1489: 1288:{\displaystyle y_{it}=\alpha +\beta 'X_{it}+\gamma y_{it-1}+u_{it}.} 1631: 98: 1463:
Fitzmaurice, Garrett M.; Laird, Nan M.; Ware, James H. (2004).
1636: 1298:
The presence of the lagged dependent variable violates strict
1374: 705:{\displaystyle X_{it},\quad i=1,\dots ,N,\quad t=1,\dots ,T,} 1569:. Cambridge: Cambridge University Press. pp. 226–254. 1610:(Second ed.). New York: Cambridge University Press. 1357:
Household, Income and Labour Dynamics in Australia Survey
1567:
Analysis of Panels and Limited Dependent Variable Models
1429: 501:(e.g., the second dataset above) is a dataset in which 1527:(Fourth ed.). Chichester: John Wiley & Sons. 1341: 394:(e.g., the first dataset above) is a dataset in which 1406:
Data sets which have a multi-dimensional panel design
1312: 1197: 1155: 1123: 1095: 1057: 1024: 997: 933: 851: 761: 741: 721: 635: 571: 551: 531: 511: 468: 448: 428: 408: 1462: 917:{\displaystyle y_{it}=\alpha +\beta 'X_{it}+u_{it},} 608:
where one row represents one observational unit for
824:{\displaystyle y_{it}=\alpha +\beta 'X_{it}+u_{it}} 1325: 1287: 1168: 1136: 1108: 1070: 1040: 1010: 981: 916: 823: 747: 727: 704: 589: 557: 537: 517: 486: 454: 434: 414: 1677:Mathematical and quantitative methods (economics) 1438:(2nd ed.). Oxford University Press. p.  402:year. Consequently, if a balanced panel contains 1653: 1188:of the dependent variable is used as regressor: 1184:Dynamic panel data describes the case where a 1467:. Hoboken: John Wiley & Sons. p. 2. 1564: 1541: 1369:Survey of Income and Program Participation 600:Both datasets above are structured in the 115:A study that uses panel data is called a 69:Learn how and when to remove this message 1588:. New York: Cambridge University Press. 398:panel member (i.e., person) is observed 32:This article includes a list of general 1522: 1490:"A Note on Cross-Panel Data Techniques" 982:{\displaystyle u_{it}=\mu _{i}+v_{it}.} 381:multiple response permutation procedure 1654: 1602: 1583: 1487: 1179: 842:Consider a generic panel data model: 442:periods, the number of observations ( 1048:is a time-varying random component. 18: 1494:Latest Developments in Econometrics 1342:Data sets which have a panel design 13: 1525:Econometric Analysis of Panel Data 38:it lacks sufficient corresponding 14: 1688: 1625: 735:is the individual dimension and 462:) in the dataset is necessarily 23: 1375:Lifelong Labour Market Database 1086:can be used to control for it. 677: 652: 1481: 1456: 1423: 1381:Panel Study of Income Dynamics 1363:British Household Panel Survey 16:Longitudinal statistical study 1: 1516: 1465:Applied Longitudinal Analysis 1434:Analysis of Longitudinal Data 1393:National Longitudinal Surveys 590:{\displaystyle n<N\cdot T} 1558:10.1016/0304-4076(94)01649-K 1488:Zaman, Khalid (2023-01-24). 7: 1412:Multidimensional panel data 615: 97:are both multi-dimensional 10: 1693: 1409: 1387:China Family Panel Studies 1084:first-difference estimator 619: 487:{\displaystyle n=N\cdot T} 122: 1523:Baltagi, Badi H. (2008). 1147:generalized least squares 270: 267: 264: 261: 258: 144: 141: 138: 135: 132: 1667:Multivariate time series 1416: 1169:{\displaystyle \mu _{i}} 1137:{\displaystyle \mu _{i}} 1109:{\displaystyle \mu _{i}} 1071:{\displaystyle \mu _{i}} 1011:{\displaystyle \mu _{i}} 1647:Korea Employment Survey 1545:Journal of Econometrics 1336:Arellano–Bond estimator 53:more precise citations. 1672:Statistical data types 1608:Analysis of Panel Data 1506:10.5281/zenodo.7565625 1327: 1289: 1170: 1138: 1110: 1072: 1042: 1041:{\displaystyle v_{it}} 1012: 983: 918: 825: 749: 729: 706: 591: 559: 539: 519: 488: 456: 436: 416: 254:MRPP unbalanced panel 1328: 1326:{\displaystyle u_{i}} 1290: 1171: 1139: 1111: 1073: 1043: 1013: 984: 919: 826: 750: 730: 707: 626:A panel has the form 592: 560: 540: 520: 489: 457: 437: 417: 1351:Socio-Economic Panel 1310: 1195: 1153: 1121: 1093: 1055: 1022: 995: 931: 849: 837:random effects model 759: 739: 719: 633: 569: 549: 529: 509: 466: 446: 426: 406: 128:MRPP balanced panel 109:cross-sectional data 1399:Labour Force Survey 833:fixed effects model 255: 129: 1584:Frees, E. (2004). 1323: 1285: 1180:Dynamic panel data 1166: 1134: 1106: 1068: 1038: 1008: 979: 914: 821: 745: 725: 702: 587: 565:) in the dataset: 555: 535: 525:panel members and 515: 484: 452: 432: 422:panel members and 412: 253: 127: 117:longitudinal study 1534:978-0-470-51886-1 748:{\displaystyle t} 728:{\displaystyle i} 558:{\displaystyle n} 538:{\displaystyle T} 518:{\displaystyle N} 455:{\displaystyle n} 435:{\displaystyle T} 415:{\displaystyle N} 377: 376: 251: 250: 95:longitudinal data 79: 78: 71: 1684: 1621: 1606:, Cheng (2003). 1599: 1580: 1561: 1538: 1510: 1509: 1485: 1479: 1478: 1460: 1454: 1453: 1437: 1427: 1332: 1330: 1329: 1324: 1322: 1321: 1294: 1292: 1291: 1286: 1281: 1280: 1265: 1264: 1240: 1239: 1227: 1210: 1209: 1175: 1173: 1172: 1167: 1165: 1164: 1143: 1141: 1140: 1135: 1133: 1132: 1115: 1113: 1112: 1107: 1105: 1104: 1077: 1075: 1074: 1069: 1067: 1066: 1047: 1045: 1044: 1039: 1037: 1036: 1017: 1015: 1014: 1009: 1007: 1006: 988: 986: 985: 980: 975: 974: 959: 958: 946: 945: 923: 921: 920: 915: 910: 909: 894: 893: 881: 864: 863: 830: 828: 827: 822: 820: 819: 804: 803: 791: 774: 773: 754: 752: 751: 746: 734: 732: 731: 726: 711: 709: 708: 703: 648: 647: 596: 594: 593: 588: 564: 562: 561: 556: 544: 542: 541: 536: 524: 522: 521: 516: 499:unbalanced panel 493: 491: 490: 485: 461: 459: 458: 453: 441: 439: 438: 433: 421: 419: 418: 413: 256: 252: 130: 126: 119:or panel study. 74: 67: 63: 60: 54: 49:this article by 40:inline citations 27: 26: 19: 1692: 1691: 1687: 1686: 1685: 1683: 1682: 1681: 1652: 1651: 1628: 1618: 1596: 1577: 1535: 1519: 1514: 1513: 1486: 1482: 1475: 1461: 1457: 1450: 1428: 1424: 1419: 1414: 1408: 1344: 1317: 1313: 1311: 1308: 1307: 1273: 1269: 1251: 1247: 1232: 1228: 1220: 1202: 1198: 1196: 1193: 1192: 1182: 1160: 1156: 1154: 1151: 1150: 1128: 1124: 1122: 1119: 1118: 1100: 1096: 1094: 1091: 1090: 1062: 1058: 1056: 1053: 1052: 1029: 1025: 1023: 1020: 1019: 1002: 998: 996: 993: 992: 967: 963: 954: 950: 938: 934: 932: 929: 928: 902: 898: 886: 882: 874: 856: 852: 850: 847: 846: 812: 808: 796: 792: 784: 766: 762: 760: 757: 756: 740: 737: 736: 720: 717: 716: 640: 636: 634: 631: 630: 624: 618: 570: 567: 566: 550: 547: 546: 530: 527: 526: 510: 507: 506: 467: 464: 463: 447: 444: 443: 427: 424: 423: 407: 404: 403: 125: 75: 64: 58: 55: 45:Please help to 44: 28: 24: 17: 12: 11: 5: 1690: 1680: 1679: 1674: 1669: 1664: 1650: 1649: 1644: 1639: 1634: 1627: 1626:External links 1624: 1623: 1622: 1616: 1600: 1594: 1581: 1575: 1562: 1552:(1): 205–227. 1539: 1533: 1518: 1515: 1512: 1511: 1480: 1473: 1455: 1448: 1421: 1420: 1418: 1415: 1410:Main article: 1407: 1404: 1403: 1402: 1396: 1390: 1384: 1378: 1372: 1366: 1360: 1354: 1343: 1340: 1320: 1316: 1296: 1295: 1284: 1279: 1276: 1272: 1268: 1263: 1260: 1257: 1254: 1250: 1246: 1243: 1238: 1235: 1231: 1226: 1223: 1219: 1216: 1213: 1208: 1205: 1201: 1181: 1178: 1163: 1159: 1131: 1127: 1103: 1099: 1065: 1061: 1035: 1032: 1028: 1005: 1001: 990: 989: 978: 973: 970: 966: 962: 957: 953: 949: 944: 941: 937: 925: 924: 913: 908: 905: 901: 897: 892: 889: 885: 880: 877: 873: 870: 867: 862: 859: 855: 818: 815: 811: 807: 802: 799: 795: 790: 787: 783: 780: 777: 772: 769: 765: 744: 724: 713: 712: 701: 698: 695: 692: 689: 686: 683: 680: 676: 673: 670: 667: 664: 661: 658: 655: 651: 646: 643: 639: 622:Panel analysis 620:Main article: 617: 614: 586: 583: 580: 577: 574: 554: 534: 514: 483: 480: 477: 474: 471: 451: 431: 411: 392:balanced panel 375: 374: 371: 368: 365: 362: 358: 357: 354: 351: 348: 345: 341: 340: 337: 334: 331: 328: 324: 323: 320: 317: 314: 311: 307: 306: 303: 300: 297: 294: 290: 289: 286: 283: 280: 277: 273: 272: 269: 266: 263: 260: 249: 248: 245: 242: 239: 236: 232: 231: 228: 225: 222: 219: 215: 214: 211: 208: 205: 202: 198: 197: 194: 191: 188: 185: 181: 180: 177: 174: 171: 168: 164: 163: 160: 157: 154: 151: 147: 146: 143: 140: 137: 134: 124: 121: 77: 76: 31: 29: 22: 15: 9: 6: 4: 3: 2: 1689: 1678: 1675: 1673: 1670: 1668: 1665: 1663: 1660: 1659: 1657: 1648: 1645: 1643: 1640: 1638: 1635: 1633: 1630: 1629: 1619: 1617:0-521-52271-4 1613: 1609: 1605: 1601: 1597: 1595:0-521-82828-7 1591: 1587: 1582: 1578: 1576:0-521-63169-6 1572: 1568: 1563: 1559: 1555: 1551: 1547: 1546: 1540: 1536: 1530: 1526: 1521: 1520: 1507: 1503: 1499: 1495: 1491: 1484: 1476: 1474:0-471-21487-6 1470: 1466: 1459: 1451: 1449:0-19-852484-6 1445: 1441: 1436: 1435: 1426: 1422: 1413: 1400: 1397: 1394: 1391: 1388: 1385: 1382: 1379: 1376: 1373: 1370: 1367: 1364: 1361: 1358: 1355: 1352: 1349: 1346: 1345: 1339: 1337: 1318: 1314: 1305: 1301: 1282: 1277: 1274: 1270: 1266: 1261: 1258: 1255: 1252: 1248: 1244: 1241: 1236: 1233: 1229: 1224: 1221: 1217: 1214: 1211: 1206: 1203: 1199: 1191: 1190: 1189: 1187: 1177: 1161: 1157: 1148: 1129: 1125: 1101: 1097: 1087: 1085: 1081: 1063: 1059: 1049: 1033: 1030: 1026: 1003: 999: 976: 971: 968: 964: 960: 955: 951: 947: 942: 939: 935: 927: 926: 911: 906: 903: 899: 895: 890: 887: 883: 878: 875: 871: 868: 865: 860: 857: 853: 845: 844: 843: 840: 838: 834: 816: 813: 809: 805: 800: 797: 793: 788: 785: 781: 778: 775: 770: 767: 763: 742: 722: 699: 696: 693: 690: 687: 684: 681: 678: 674: 671: 668: 665: 662: 659: 656: 653: 649: 644: 641: 637: 629: 628: 627: 623: 613: 611: 607: 603: 598: 584: 581: 578: 575: 572: 552: 532: 512: 504: 500: 495: 481: 478: 475: 472: 469: 449: 429: 409: 401: 397: 393: 388: 386: 382: 372: 369: 366: 363: 360: 359: 355: 352: 349: 346: 343: 342: 338: 335: 332: 329: 326: 325: 321: 318: 315: 312: 309: 308: 304: 301: 298: 295: 292: 291: 287: 284: 281: 278: 275: 274: 257: 246: 243: 240: 237: 234: 233: 229: 226: 223: 220: 217: 216: 212: 209: 206: 203: 200: 199: 195: 192: 189: 186: 183: 182: 178: 175: 172: 169: 166: 165: 161: 158: 155: 152: 149: 148: 131: 120: 118: 113: 110: 106: 102: 100: 96: 92: 88: 84: 73: 70: 62: 52: 48: 42: 41: 35: 30: 21: 20: 1607: 1585: 1566: 1549: 1543: 1524: 1497: 1493: 1483: 1464: 1458: 1433: 1425: 1347: 1297: 1183: 1088: 1050: 991: 841: 714: 625: 609: 605: 601: 599: 503:at least one 502: 498: 496: 399: 395: 391: 389: 384: 380: 378: 114: 103: 94: 90: 87:econometrics 80: 65: 56: 37: 1304:endogeneity 1302:, that is, 606:wide format 602:long format 105:Time series 51:introducing 1662:Panel data 1656:Categories 1517:References 1500:(1): 1–7. 1300:exogeneity 91:panel data 83:statistics 34:references 1259:− 1245:γ 1222:β 1215:α 1158:μ 1126:μ 1098:μ 1060:μ 1000:μ 952:μ 876:β 869:α 786:β 779:α 691:… 666:… 582:⋅ 479:⋅ 59:June 2020 1225:′ 879:′ 835:and the 789:′ 616:Analysis 1642:pairfam 1377:(LLMDB) 1359:(HILDA) 379:In the 265:income 259:person 139:income 133:person 123:Example 47:improve 1614:  1592:  1573:  1531:  1471:  1446:  1395:(NLSY) 1389:(CFPS) 1383:(PSID) 1371:(SIPP) 1365:(BHPS) 1353:(SOEP) 1348:German 715:where 36:, but 1637:KLIPS 1604:Hsiao 1417:Notes 1401:(LFS) 400:every 262:year 136:year 1632:PSID 1612:ISBN 1590:ISBN 1571:ISBN 1529:ISBN 1469:ISBN 1444:ISBN 576:< 396:each 385:MRPP 367:3300 364:2017 350:2100 347:2018 333:2000 330:2017 316:1900 313:2016 299:1500 296:2017 282:1600 279:2016 271:sex 268:age 241:2400 238:2018 224:2300 221:2017 207:2000 204:2016 190:2000 187:2018 173:1600 170:2017 156:1300 153:2016 145:sex 142:age 107:and 99:data 93:and 85:and 1554:doi 1502:doi 1186:lag 1089:If 1080:OLS 1051:If 610:all 497:An 81:In 1658:: 1550:68 1548:. 1496:. 1492:. 1442:. 1176:. 839:. 597:. 494:. 390:A 373:1 370:34 356:2 353:43 339:2 336:42 322:2 319:41 305:1 302:24 288:1 285:23 247:2 244:40 230:2 227:39 213:2 210:38 196:1 193:29 179:1 176:28 162:1 159:27 89:, 1620:. 1598:. 1579:. 1560:. 1556:: 1537:. 1508:. 1504:: 1498:1 1477:. 1452:. 1440:2 1319:i 1315:u 1283:. 1278:t 1275:i 1271:u 1267:+ 1262:1 1256:t 1253:i 1249:y 1242:+ 1237:t 1234:i 1230:X 1218:+ 1212:= 1207:t 1204:i 1200:y 1162:i 1130:i 1102:i 1064:i 1034:t 1031:i 1027:v 1004:i 977:. 972:t 969:i 965:v 961:+ 956:i 948:= 943:t 940:i 936:u 912:, 907:t 904:i 900:u 896:+ 891:t 888:i 884:X 872:+ 866:= 861:t 858:i 854:y 817:t 814:i 810:u 806:+ 801:t 798:i 794:X 782:+ 776:= 771:t 768:i 764:y 743:t 723:i 700:, 697:T 694:, 688:, 685:1 682:= 679:t 675:, 672:N 669:, 663:, 660:1 657:= 654:i 650:, 645:t 642:i 638:X 585:T 579:N 573:n 553:n 533:T 513:N 482:T 476:N 473:= 470:n 450:n 430:T 410:N 383:( 361:3 344:2 327:2 310:2 293:1 276:1 235:2 218:2 201:2 184:1 167:1 150:1 72:) 66:( 61:) 57:( 43:.

Index

references
inline citations
improve
introducing
Learn how and when to remove this message
statistics
econometrics
data
Time series
cross-sectional data
longitudinal study
Panel analysis
fixed effects model
random effects model
OLS
first-difference estimator
generalized least squares
lag
exogeneity
endogeneity
Arellano–Bond estimator
Socio-Economic Panel
Household, Income and Labour Dynamics in Australia Survey
British Household Panel Survey
Survey of Income and Program Participation
Lifelong Labour Market Database
Panel Study of Income Dynamics
China Family Panel Studies
National Longitudinal Surveys
Labour Force Survey

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.

↑