Knowledge

Tunstall coding

Source đź“ť

2296: 2286: 806: 338: 941:
probability of 25%, being of length 2 trying to read from implied data. A 'B' such read does not read any further, but with 75% probability we read 'A' or 'C', requiring another code. Thus the efficiency of the read is 2.75 ( average length of the size 7 Huffman code ) / 1.75 ( average length of the 1 or 2-digit base - 3 Tunstall code ) =
813:
This is an example of a Tunstall code being used to read ( for transmit ) any data that is scrambled, e.g. by polynomial scrambling. This particular example helps to modify the base of the data from 2 to 3 in a stream therefore avoiding expensive base modification routines. With base modification we
868:
bits per code, our reads do not result in lesser margin of efficiency of transmission for which we are employing the base modification in the first place. We can therefore then employ the read-to-modify-base mechanism for efficiently transmitting the data across channels that have a different base.
417:
contains only characters from the string "hello, world" — that is, 'h', 'e', 'l', ',', ' ', 'w', 'o', 'r', 'd'. We can therefore compute the probability of each character based on its statistical appearance in the input string. For instance, the letter L appears thrice in a string of 12 characters:
940:
We are essentially reading perfectly scrambled binary data or 'implied data' for the purpose of transmitting it using base-3 channels. Please see leaf nodes in the Ternary Tunstall Tree. As we can see, the read will result in the first digit being 'B' - 25% of the time as it has an implied
727: 542: 614:
leaves, one for each character. We re-compute the probabilities of those leaves. For instance, the sequence of two letters L happens once. Given that there are three occurrences of letters followed by an L, the resulting probability is
666: 44:
Tunstall coding was the subject of Brian Parker Tunstall's PhD thesis in 1967, while at Georgia Institute of Technology. The subject of that thesis was "Synthesis of noiseless compression codes"
720: 535: 786:
Tunstall coding requires the algorithm to know, prior to the parsing operation, what the distribution of probabilities for each letter of the alphabet is. This issue is shared with
776: 612: 484: 998: 322: 228: 415: 252: 151: 441: 288: 959: 866: 839: 572: 1021: 115: 191: 171: 486:
leaves. Each word is therefore directly associated to a letter of the alphabet. The 9 words that we thus obtain can be encoded into a fixed-sized output of
869:
eg. transmitting binary data across say MLT-3 channels with increased efficiency when compared to mapping codes ( with large number of unused codes ).
193:, is constructed as a tree of probabilities, in which each edge is associated to a letter from the input alphabet. The algorithm goes like this: 1120: 1788: 1599: 393:
Let's imagine that we wish to encode the string "hello, world". Let's further assume (somewhat unrealistically) that the input alphabet
1488: 2330: 1994: 1817: 1611: 1302: 726: 618: 1999: 1576: 541: 841:
bits are used at an average to read the code. This ensures that upon use of the new base, which is duty bound to use at best
1729: 2106: 1844: 1783: 1594: 1544: 1367: 88:
It can be shown that, for a large enough dictionary, the number of bits per source letter can be arbitrarily close to
1227: 1212: 1113: 380: 2219: 1086: 674: 362: 489: 2229: 2067: 1918: 1837: 1631: 1045: 2202: 1822: 1616: 1404: 2299: 1335: 1076: 1964: 2289: 2192: 1734: 1292: 1106: 118: 735: 173:, which is an upper bound to the size of the dictionary that it will compute. The dictionary in question, 1282: 1277: 153:, along with a distribution of probabilities for each word input. It also requires an arbitrary constant 577: 449: 2224: 2151: 1989: 1969: 1913: 1571: 1362: 1165: 964: 293: 199: 2325: 2234: 2175: 2101: 1949: 1539: 1534: 1389: 1232: 353: 33: 396: 233: 132: 2239: 1812: 1606: 1307: 2180: 1551: 1438: 1394: 1207: 1190: 1180: 421: 78:
Both Tunstall codes and Lempel–Ziv codes represent variable-length words by fixed-length codes.
1805: 1556: 1340: 1185: 2077: 257: 2209: 944: 1893: 1355: 1317: 1138: 844: 817: 550: 60: 91: 8: 2124: 2015: 1974: 1959: 1928: 1923: 1832: 1739: 1672: 1641: 1626: 1409: 1074: 1003: 1058: 2197: 2167: 2146: 2052: 1984: 1878: 1566: 1382: 1372: 1267: 1247: 1242: 797:, which has a similar dictionary-based design, but with a variable-sized block output. 176: 156: 21: 1778: 2141: 2129: 2111: 1979: 1863: 1800: 1646: 1561: 1517: 1478: 1160: 348: 2116: 2072: 2045: 2040: 1898: 1883: 1793: 1702: 1697: 1526: 1259: 1237: 1129: 17: 2035: 1849: 1773: 1754: 1724: 1692: 1658: 1155: 85:, Tunstall coding parses a stochastic source with codewords of variable length. 1827: 1621: 1350: 1345: 1202: 1175: 1147: 794: 787: 68: 64: 48: 29: 2319: 2134: 2082: 1749: 1744: 1719: 1651: 1272: 1170: 2255: 1222: 1197: 1098: 671:
We obtain 17 words, which can each be encoded into a fixed-sized output of
2214: 2092: 1888: 1764: 1714: 82: 805: 2271: 2062: 2057: 1944: 1903: 1709: 1073:"Variable to fixed length adaptive source coding - Lempel-Ziv coding". 1023:. We can then transmit the symbols using base-3 channels efficiently. 732:
Note that we could iterate further, increasing the number of words by
2185: 2030: 1687: 1954: 1428: 1377: 1468: 814:
are particularly bound by 'efficiency' of reads, where ideally
793:
Its requiring a fixed-length block output makes it lesser than
2303: 1908: 1501: 1448: 1458: 1312: 1297: 1287: 1089: 72: 661:{\displaystyle {1 \over 3}\cdot {3 \over 12}={1 \over 12}} 1433: 1399: 1062: 1039: 1006: 967: 947: 847: 820: 1059:
http://www.rle.mit.edu/rgallager/documents/notes1.pdf
800: 738: 677: 621: 580: 553: 492: 452: 425: 399: 296: 260: 236: 202: 179: 159: 135: 94: 75:
which maps source symbols to a fixed number of bits.
547:
We then take the leaf of highest probability (here,
1015: 992: 953: 860: 833: 770: 714: 660: 606: 566: 529: 478: 435: 409: 316: 282: 246: 222: 185: 165: 145: 129:The algorithm requires as input an input alphabet 109: 2317: 446:We initialize the tree, starting with a tree of 290:: Convert most probable leaf to tree with 1114: 715:{\displaystyle \lceil \log _{2}(17)\rceil =5} 1128: 703: 678: 530:{\displaystyle \lceil \log _{2}(9)\rceil =4} 518: 493: 1121: 1107: 961:which is as per requirement very close to 1040:Tunstall, Brian Parker (September 1967). 574:), and convert it to yet another tree of 381:Learn how and when to remove this message 1042:Synthesis of noiseless compression codes 804: 2318: 1102: 1088:, Study of Tunstall's algorithm from 1000:which calculates to an efficiency of 771:{\displaystyle |{\mathcal {U}}|-1=8} 331: 1061:, Study of Tunstall's algorithm at 13: 1010: 801:Implied Read for base modification 746: 607:{\displaystyle |{\mathcal {U}}|=9} 588: 479:{\displaystyle |{\mathcal {U}}|=9} 460: 402: 304: 239: 210: 138: 14: 2342: 993:{\textstyle \log _{2}3=1.5849625} 2295: 2294: 2285: 2284: 1092:'s Information Theory department 725: 540: 336: 317:{\displaystyle |{\mathcal {U}}|} 223:{\displaystyle |{\mathcal {U}}|} 2331:Lossless compression algorithms 1046:Georgia Institute of Technology 230:leaves, one for each letter in 1080: 1067: 1052: 1033: 781: 752: 740: 700: 694: 594: 582: 515: 509: 466: 454: 410:{\displaystyle {\mathcal {U}}} 310: 298: 270: 262: 247:{\displaystyle {\mathcal {U}}} 216: 204: 146:{\displaystyle {\mathcal {U}}} 104: 98: 1: 1026: 54: 47:Its design is a precursor to 124: 7: 356:. The specific problem is: 10: 2347: 2176:Compressed data structures 1498:RLE + BWT + MTF + Huffman 1166:Asymmetric numeral systems 436:{\displaystyle 3 \over 12} 327: 39: 2280: 2264: 2248: 2166: 2091: 2023: 2014: 1937: 1871: 1862: 1763: 1680: 1671: 1587: 1535:Discrete cosine transform 1525: 1516: 1465:LZ77 + Huffman + context 1418: 1328: 1258: 1146: 1137: 34:lossless data compression 2240:Smallest grammar problem 283:{\displaystyle |D|<C} 2181:Compressed suffix array 1730:Nyquist–Shannon theorem 954:{\textstyle 1.57142857} 71:, Tunstall coding is a 1017: 994: 955: 862: 861:{\textstyle \log _{n}} 835: 834:{\textstyle \log _{n}} 810: 772: 716: 662: 608: 568: 531: 480: 437: 411: 318: 284: 248: 224: 187: 167: 147: 111: 2210:Kolmogorov complexity 2078:Video characteristics 1455:LZ77 + Huffman + ANS 1018: 995: 956: 863: 836: 809:Ternary Tunstall Tree 808: 773: 717: 663: 609: 569: 567:{\displaystyle w_{1}} 532: 481: 438: 412: 319: 285: 249: 225: 188: 168: 148: 112: 61:variable-length codes 2300:Compression software 1894:Compression artifact 1850:Psychoacoustic model 1016:{\textstyle 99.15\%} 1004: 965: 945: 845: 818: 736: 675: 619: 578: 551: 490: 450: 422: 397: 363:improve this article 358:wrong probabilities. 352:to meet Knowledge's 294: 258: 234: 200: 177: 157: 133: 110:{\displaystyle H(U)} 92: 83:typical set encoding 2290:Compression formats 1929:Texture compression 1924:Standard test image 1740:Silence compression 418:its probability is 2198:Information theory 2053:Display resolution 1879:Chroma subsampling 1268:Byte pair encoding 1213:Shannon–Fano–Elias 1013: 990: 951: 858: 831: 811: 768: 712: 658: 604: 564: 527: 476: 429: 407: 314: 280: 244: 220: 196:D := tree of 183: 163: 143: 107: 22:information theory 2313: 2312: 2162: 2161: 2112:Deblocking filter 2010: 2009: 1858: 1857: 1667: 1666: 1512: 1511: 938: 937: 656: 643: 630: 433: 391: 390: 383: 354:quality standards 345:This article may 186:{\displaystyle D} 166:{\displaystyle C} 69:Lempel–Ziv coding 2338: 2326:Data compression 2298: 2297: 2288: 2287: 2117:Lapped transform 2021: 2020: 1899:Image resolution 1884:Coding tree unit 1869: 1868: 1678: 1677: 1523: 1522: 1144: 1143: 1130:Data compression 1123: 1116: 1109: 1100: 1099: 1093: 1084: 1078: 1071: 1065: 1056: 1050: 1049: 1037: 1022: 1020: 1019: 1014: 999: 997: 996: 991: 977: 976: 960: 958: 957: 952: 872: 871: 867: 865: 864: 859: 857: 856: 840: 838: 837: 832: 830: 829: 777: 775: 774: 769: 755: 750: 749: 743: 729: 721: 719: 718: 713: 690: 689: 667: 665: 664: 659: 657: 649: 644: 636: 631: 623: 613: 611: 610: 605: 597: 592: 591: 585: 573: 571: 570: 565: 563: 562: 544: 536: 534: 533: 528: 505: 504: 485: 483: 482: 477: 469: 464: 463: 457: 442: 440: 439: 434: 424: 416: 414: 413: 408: 406: 405: 386: 379: 375: 372: 366: 340: 339: 332: 323: 321: 320: 315: 313: 308: 307: 301: 289: 287: 286: 281: 273: 265: 253: 251: 250: 245: 243: 242: 229: 227: 226: 221: 219: 214: 213: 207: 192: 190: 189: 184: 172: 170: 169: 164: 152: 150: 149: 144: 142: 141: 116: 114: 113: 108: 63:, which include 18:computer science 2346: 2345: 2341: 2340: 2339: 2337: 2336: 2335: 2316: 2315: 2314: 2309: 2276: 2260: 2244: 2225:Rate–distortion 2158: 2087: 2006: 1933: 1854: 1759: 1755:Sub-band coding 1663: 1588:Predictive type 1583: 1508: 1475:LZSS + Huffman 1425:LZ77 + Huffman 1414: 1324: 1260:Dictionary type 1254: 1156:Adaptive coding 1133: 1127: 1097: 1096: 1085: 1081: 1072: 1068: 1057: 1053: 1038: 1034: 1029: 1005: 1002: 1001: 972: 968: 966: 963: 962: 946: 943: 942: 852: 848: 846: 843: 842: 825: 821: 819: 816: 815: 803: 784: 751: 745: 744: 739: 737: 734: 733: 685: 681: 676: 673: 672: 648: 635: 622: 620: 617: 616: 593: 587: 586: 581: 579: 576: 575: 558: 554: 552: 549: 548: 500: 496: 491: 488: 487: 465: 459: 458: 453: 451: 448: 447: 423: 420: 419: 401: 400: 398: 395: 394: 387: 376: 370: 367: 360: 341: 337: 330: 325: 309: 303: 302: 297: 295: 292: 291: 269: 261: 259: 256: 255: 238: 237: 235: 232: 231: 215: 209: 208: 203: 201: 198: 197: 178: 175: 174: 158: 155: 154: 137: 136: 134: 131: 130: 127: 121:of the source. 93: 90: 89: 57: 42: 26:Tunstall coding 12: 11: 5: 2344: 2334: 2333: 2328: 2311: 2310: 2308: 2307: 2292: 2281: 2278: 2277: 2275: 2274: 2268: 2266: 2262: 2261: 2259: 2258: 2252: 2250: 2246: 2245: 2243: 2242: 2237: 2232: 2227: 2222: 2217: 2212: 2207: 2206: 2205: 2195: 2190: 2189: 2188: 2183: 2172: 2170: 2164: 2163: 2160: 2159: 2157: 2156: 2155: 2154: 2149: 2139: 2138: 2137: 2132: 2127: 2119: 2114: 2109: 2104: 2098: 2096: 2089: 2088: 2086: 2085: 2080: 2075: 2070: 2065: 2060: 2055: 2050: 2049: 2048: 2043: 2038: 2027: 2025: 2018: 2012: 2011: 2008: 2007: 2005: 2004: 2003: 2002: 1997: 1992: 1987: 1977: 1972: 1967: 1962: 1957: 1952: 1947: 1941: 1939: 1935: 1934: 1932: 1931: 1926: 1921: 1916: 1911: 1906: 1901: 1896: 1891: 1886: 1881: 1875: 1873: 1866: 1860: 1859: 1856: 1855: 1853: 1852: 1847: 1842: 1841: 1840: 1835: 1830: 1825: 1820: 1810: 1809: 1808: 1798: 1797: 1796: 1791: 1781: 1776: 1770: 1768: 1761: 1760: 1758: 1757: 1752: 1747: 1742: 1737: 1732: 1727: 1722: 1717: 1712: 1707: 1706: 1705: 1700: 1695: 1684: 1682: 1675: 1669: 1668: 1665: 1664: 1662: 1661: 1659:Psychoacoustic 1656: 1655: 1654: 1649: 1644: 1636: 1635: 1634: 1629: 1624: 1619: 1614: 1604: 1603: 1602: 1591: 1589: 1585: 1584: 1582: 1581: 1580: 1579: 1574: 1569: 1559: 1554: 1549: 1548: 1547: 1542: 1531: 1529: 1527:Transform type 1520: 1514: 1513: 1510: 1509: 1507: 1506: 1505: 1504: 1496: 1495: 1494: 1491: 1483: 1482: 1481: 1473: 1472: 1471: 1463: 1462: 1461: 1453: 1452: 1451: 1443: 1442: 1441: 1436: 1431: 1422: 1420: 1416: 1415: 1413: 1412: 1407: 1402: 1397: 1392: 1387: 1386: 1385: 1380: 1370: 1365: 1360: 1359: 1358: 1348: 1343: 1338: 1332: 1330: 1326: 1325: 1323: 1322: 1321: 1320: 1315: 1310: 1305: 1300: 1295: 1290: 1285: 1280: 1270: 1264: 1262: 1256: 1255: 1253: 1252: 1251: 1250: 1245: 1240: 1235: 1225: 1220: 1215: 1210: 1205: 1200: 1195: 1194: 1193: 1188: 1183: 1173: 1168: 1163: 1158: 1152: 1150: 1141: 1135: 1134: 1126: 1125: 1118: 1111: 1103: 1095: 1094: 1079: 1066: 1051: 1031: 1030: 1028: 1025: 1012: 1009: 989: 986: 983: 980: 975: 971: 950: 936: 935: 932: 928: 927: 924: 920: 919: 916: 912: 911: 908: 904: 903: 900: 896: 895: 892: 888: 887: 884: 880: 879: 876: 855: 851: 828: 824: 802: 799: 788:Huffman coding 783: 780: 767: 764: 761: 758: 754: 748: 742: 711: 708: 705: 702: 699: 696: 693: 688: 684: 680: 655: 652: 647: 642: 639: 634: 629: 626: 603: 600: 596: 590: 584: 561: 557: 526: 523: 520: 517: 514: 511: 508: 503: 499: 495: 475: 472: 468: 462: 456: 432: 428: 404: 389: 388: 344: 342: 335: 329: 326: 312: 306: 300: 279: 276: 272: 268: 264: 241: 218: 212: 206: 195: 182: 162: 140: 126: 123: 106: 103: 100: 97: 56: 53: 41: 38: 30:entropy coding 9: 6: 4: 3: 2: 2343: 2332: 2329: 2327: 2324: 2323: 2321: 2305: 2301: 2293: 2291: 2283: 2282: 2279: 2273: 2270: 2269: 2267: 2263: 2257: 2254: 2253: 2251: 2247: 2241: 2238: 2236: 2233: 2231: 2228: 2226: 2223: 2221: 2218: 2216: 2213: 2211: 2208: 2204: 2201: 2200: 2199: 2196: 2194: 2191: 2187: 2184: 2182: 2179: 2178: 2177: 2174: 2173: 2171: 2169: 2165: 2153: 2150: 2148: 2145: 2144: 2143: 2140: 2136: 2133: 2131: 2128: 2126: 2123: 2122: 2120: 2118: 2115: 2113: 2110: 2108: 2105: 2103: 2100: 2099: 2097: 2094: 2090: 2084: 2083:Video quality 2081: 2079: 2076: 2074: 2071: 2069: 2066: 2064: 2061: 2059: 2056: 2054: 2051: 2047: 2044: 2042: 2039: 2037: 2034: 2033: 2032: 2029: 2028: 2026: 2022: 2019: 2017: 2013: 2001: 1998: 1996: 1993: 1991: 1988: 1986: 1983: 1982: 1981: 1978: 1976: 1973: 1971: 1968: 1966: 1963: 1961: 1958: 1956: 1953: 1951: 1948: 1946: 1943: 1942: 1940: 1936: 1930: 1927: 1925: 1922: 1920: 1917: 1915: 1912: 1910: 1907: 1905: 1902: 1900: 1897: 1895: 1892: 1890: 1887: 1885: 1882: 1880: 1877: 1876: 1874: 1870: 1867: 1865: 1861: 1851: 1848: 1846: 1843: 1839: 1836: 1834: 1831: 1829: 1826: 1824: 1821: 1819: 1816: 1815: 1814: 1811: 1807: 1804: 1803: 1802: 1799: 1795: 1792: 1790: 1787: 1786: 1785: 1782: 1780: 1777: 1775: 1772: 1771: 1769: 1766: 1762: 1756: 1753: 1751: 1750:Speech coding 1748: 1746: 1745:Sound quality 1743: 1741: 1738: 1736: 1733: 1731: 1728: 1726: 1723: 1721: 1720:Dynamic range 1718: 1716: 1713: 1711: 1708: 1704: 1701: 1699: 1696: 1694: 1691: 1690: 1689: 1686: 1685: 1683: 1679: 1676: 1674: 1670: 1660: 1657: 1653: 1650: 1648: 1645: 1643: 1640: 1639: 1637: 1633: 1630: 1628: 1625: 1623: 1620: 1618: 1615: 1613: 1610: 1609: 1608: 1605: 1601: 1598: 1597: 1596: 1593: 1592: 1590: 1586: 1578: 1575: 1573: 1570: 1568: 1565: 1564: 1563: 1560: 1558: 1555: 1553: 1550: 1546: 1543: 1541: 1538: 1537: 1536: 1533: 1532: 1530: 1528: 1524: 1521: 1519: 1515: 1503: 1500: 1499: 1497: 1492: 1490: 1487: 1486: 1485:LZ77 + Range 1484: 1480: 1477: 1476: 1474: 1470: 1467: 1466: 1464: 1460: 1457: 1456: 1454: 1450: 1447: 1446: 1444: 1440: 1437: 1435: 1432: 1430: 1427: 1426: 1424: 1423: 1421: 1417: 1411: 1408: 1406: 1403: 1401: 1398: 1396: 1393: 1391: 1388: 1384: 1381: 1379: 1376: 1375: 1374: 1371: 1369: 1366: 1364: 1361: 1357: 1354: 1353: 1352: 1349: 1347: 1344: 1342: 1339: 1337: 1334: 1333: 1331: 1327: 1319: 1316: 1314: 1311: 1309: 1306: 1304: 1301: 1299: 1296: 1294: 1291: 1289: 1286: 1284: 1281: 1279: 1276: 1275: 1274: 1271: 1269: 1266: 1265: 1263: 1261: 1257: 1249: 1246: 1244: 1241: 1239: 1236: 1234: 1231: 1230: 1229: 1226: 1224: 1221: 1219: 1216: 1214: 1211: 1209: 1206: 1204: 1201: 1199: 1196: 1192: 1189: 1187: 1184: 1182: 1179: 1178: 1177: 1174: 1172: 1169: 1167: 1164: 1162: 1159: 1157: 1154: 1153: 1151: 1149: 1145: 1142: 1140: 1136: 1131: 1124: 1119: 1117: 1112: 1110: 1105: 1104: 1101: 1091: 1087: 1083: 1077: 1075: 1070: 1064: 1060: 1055: 1047: 1043: 1036: 1032: 1024: 1007: 987: 984: 981: 978: 973: 969: 948: 933: 930: 929: 925: 922: 921: 917: 914: 913: 909: 906: 905: 901: 898: 897: 893: 890: 889: 885: 882: 881: 877: 874: 873: 870: 853: 849: 826: 822: 807: 798: 796: 791: 789: 779: 765: 762: 759: 756: 730: 728: 723: 709: 706: 697: 691: 686: 682: 669: 653: 650: 645: 640: 637: 632: 627: 624: 601: 598: 559: 555: 545: 543: 538: 524: 521: 512: 506: 501: 497: 473: 470: 444: 430: 426: 385: 382: 374: 364: 359: 355: 351: 350: 343: 334: 333: 277: 274: 266: 194: 180: 160: 122: 120: 101: 95: 86: 84: 79: 76: 74: 70: 66: 62: 52: 50: 45: 37: 35: 31: 28:is a form of 27: 23: 19: 2256:Hutter Prize 2220:Quantization 2125:Compensation 1919:Quantization 1642:Compensation 1217: 1208:Shannon–Fano 1148:Entropy type 1082: 1069: 1054: 1041: 1035: 939: 812: 792: 785: 778:every time. 731: 724: 670: 546: 539: 445: 392: 377: 368: 361:Please help 357: 346: 128: 87: 80: 77: 58: 46: 43: 25: 15: 2215:Prefix code 2068:Frame types 1889:Color space 1715:Convolution 1445:LZ77 + ANS 1356:Incremental 1329:Other types 1248:Levenshtein 782:Limitations 371:August 2014 365:if you can. 2320:Categories 2272:Mark Adler 2230:Redundancy 2147:Daubechies 2130:Estimation 2063:Frame rate 1985:Daubechies 1945:Chain code 1904:Macroblock 1710:Companding 1647:Estimation 1567:Daubechies 1273:Lempel–Ziv 1233:Exp-Golomb 1161:Arithmetic 1027:References 949:1.57142857 795:Lempel–Ziv 55:Properties 49:Lempel–Ziv 2249:Community 2073:Interlace 1459:Zstandard 1238:Fibonacci 1228:Universal 1186:Canonical 1011:% 988:1.5849625 979:⁡ 757:− 704:⌉ 692:⁡ 679:⌈ 633:⋅ 519:⌉ 507:⁡ 494:⌈ 125:Algorithm 32:used for 2235:Symmetry 2203:Timeline 2186:FM-index 2031:Bit rate 2024:Concepts 1872:Concepts 1735:Sampling 1688:Bit rate 1681:Concepts 1383:Sequitur 1218:Tunstall 1191:Modified 1181:Adaptive 1139:Lossless 347:require 324:leaves. 254:. While 2193:Entropy 2142:Wavelet 2121:Motion 1980:Wavelet 1960:Fractal 1955:Deflate 1938:Methods 1725:Latency 1638:Motion 1562:Wavelet 1479:LHA/LZH 1429:Deflate 1378:Re-Pair 1373:Grammar 1203:Shannon 1176:Huffman 1132:methods 875:Symbol 349:cleanup 328:Example 119:entropy 81:Unlike 65:Huffman 59:Unlike 40:History 2304:codecs 2265:People 2168:Theory 2135:Vector 1652:Vector 1469:Brotli 1419:Hybrid 1318:Snappy 1171:Golomb 722:bits. 537:bits. 117:, the 2095:parts 2093:Codec 2058:Frame 2016:Video 2000:SPIHT 1909:Pixel 1864:Image 1818:ACELP 1789:ADPCM 1779:ÎĽ-law 1774:A-law 1767:parts 1765:Codec 1673:Audio 1612:ACELP 1600:ADPCM 1577:SPIHT 1518:Lossy 1502:bzip2 1493:LZHAM 1449:LZFSE 1351:Delta 1243:Gamma 1223:Unary 1198:Range 1008:99.15 878:Code 2107:DPCM 1914:PSNR 1845:MDCT 1838:WLPC 1823:CELP 1784:DPCM 1632:WLPC 1617:CELP 1595:DPCM 1545:MDCT 1489:LZMA 1390:LDCT 1368:DPCM 1313:LZWL 1303:LZSS 1298:LZRW 1288:LZJB 1090:EPFL 934:111 926:110 918:101 902:100 894:011 886:010 275:< 73:code 67:and 20:and 2152:DWT 2102:DCT 2046:VBR 2041:CBR 2036:ABR 1995:EZW 1990:DWT 1975:RLE 1965:KLT 1950:DCT 1833:LSP 1828:LAR 1813:LPC 1806:FFT 1703:VBR 1698:CBR 1693:ABR 1627:LSP 1622:LAR 1607:LPC 1572:DWT 1557:FFT 1552:DST 1540:DCT 1439:LZS 1434:LZX 1410:RLE 1405:PPM 1400:PAQ 1395:MTF 1363:DMC 1341:CTW 1336:BWT 1308:LZW 1293:LZO 1283:LZ4 1278:842 1063:MIT 970:log 931:CC 923:CB 915:CA 910:00 899:AC 891:AB 883:AA 850:log 823:log 683:log 498:log 16:In 2322:: 1970:LP 1801:FT 1794:DM 1346:CM 1044:. 907:B 790:. 698:17 668:. 654:12 641:12 443:. 431:12 51:. 36:. 24:, 2306:) 2302:( 1122:e 1115:t 1108:v 1048:. 985:= 982:3 974:2 854:n 827:n 766:8 763:= 760:1 753:| 747:U 741:| 710:5 707:= 701:) 695:( 687:2 651:1 646:= 638:3 628:3 625:1 602:9 599:= 595:| 589:U 583:| 560:1 556:w 525:4 522:= 516:) 513:9 510:( 502:2 474:9 471:= 467:| 461:U 455:| 427:3 403:U 384:) 378:( 373:) 369:( 311:| 305:U 299:| 278:C 271:| 267:D 263:| 240:U 217:| 211:U 205:| 181:D 161:C 139:U 105:) 102:U 99:( 96:H

Index

computer science
information theory
entropy coding
lossless data compression
Lempel–Ziv
variable-length codes
Huffman
Lempel–Ziv coding
code
typical set encoding
entropy
cleanup
quality standards
improve this article
Learn how and when to remove this message
Tunstall "hello, world" example — one iteration
Tunstall "hello, world" example — two iterations
Huffman coding
Lempel–Ziv

Georgia Institute of Technology
http://www.rle.mit.edu/rgallager/documents/notes1.pdf
MIT



EPFL
v
t
e

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.

↑