Knowledge

Digital compositing

Source 📝

212: 129: 438:, suggesting it is safe to re-group operations to F=(A*B)*(C*D), i.e. without changing their order. In this case, we may compute S:=A*B once and save this result. To form F with an associative operator, we need only do two additional compositing operations to integrate the new layer S, by computing F:=S*(C*D). This expression indicates compositing C with all of the layers below it in one step, and then blending all of the layers on top of it with the previous result to produce the final image in the second step. 466:, is no longer in production). Due to the limitations of processing speed and memory, compositing artists did not usually have the luxury of having the system make intermediate conversions to linear space for the compositing steps. Over time, the limitations have become much less significant, and now most compositing is done in a linear color space, even in cases where the source imagery is in a logarithmic color space. 33: 496:, linking media objects and effects in a procedural map, intuitively laying out the progression from source input to final output, and is in fact the way all compositing applications internally handle composites. This type of compositing interface allows great flexibility, including the ability to modify the parameters of an earlier image processing step "in context" (while viewing the final 74: 261:
As a simple example, suppose two images of the same size are available and they are to be composited. The input images are referred to as the foreground image and the background image. Each image consists of the same number of pixels. Compositing is performed by mathematically combining information
449:
even when there is no gain from pre-computation. Again, consider the image F=A*(B*(C*D)). Each compositing operation in this expression depends on the next, leading to serial computation. However, associativity can allow us to rewrite F=(A*B)*(C*D) where there are clearly two operations that do
354:") along sharp edges in the matte. More generally, nonlinear compositing can have effects such as "halos" around composited objects, because the influence of the alpha channel is non-linear. It is possible for a compositing artist to compensate for the effects of compositing in non-linear space. 425:
Consider the case when we have four layers to blend to produce the final image: F=A*(B*(C*D)) where A, B, C, D are partially transparent image layers and "*" denotes a compositing operator (with the left layer on top of the right layer). If only layer C changes, we should find a way to avoid
541:
effects, such as in motion graphics, but becomes awkward for more complex composites entailing numerous layers. A partial solution to this is some programs' ability to view the composite-order of elements (such as images, effects, or other attributes) with a visual diagram called a
546:
to nest compositions, or "comps," directly into other compositions, thereby adding complexity to the render-order by first compositing layers in the beginning composition, then combining that resultant image with the layered images from the proceeding composition, and so on.
421:
When many partially transparent layers need to be composited together, it is worthwhile to consider the algebraic properties of compositing operators used. Specifically, the associativity and commutativity determine when repeated calculation can or cannot be avoided.
527:
Layer-based compositing represents each media object in a composite as a separate layer within a timeline, each with its own time bounds, effects, and keyframes. All the layers are stacked, one above the next, in any desired order; and the bottom layer is usually
532:
as a base in the resultant image, with each higher layer being progressively rendered on top of the previously composited of layers, moving upward until all layers have been rendered into the final composite. Layer-based compositing is very well suited for rapid
434:, it is safe to re-order the blending operations. In this case, we might compute T=A*(B*D) only once and simply blend T*C to produce F, a single operation. Unfortunately, most operators are not commutative. However, many are 357:
Performing alpha blending is an expensive operation if performed on an entire image or 3D scene. If this operation has to be done in real time video games, there is an easy trick to boost performance.
450:
not depend on each other that may be executed in parallel. In general, we can build a tree of pair-wise compositing operations with a height that is logarithmic in the number of layers.
504:
and time effects poorly, as their workflow does not stem directly from a timeline, as do layer-based compositing packages. Software which incorporates a node based interface include
346:
Note that if the operations are performed in a colour space where γ is not equal to 1 then the operation will lead to non-linear effects which can potentially be seen as
426:
re-blending all of the layers when computing F. Without any special considerations, four full-image blends would need to occur. For compositing operators that are
299:, and assuming that the colour channels are expressed in a γ=1 colour space (that is to say, the measured values are proportional to light intensity), we have: 773: 808: 904: 803: 92: 462:, which operated in a logarithmic color space, which more closely mimics the natural light response of film emulsions (the Cineon System, made by 843: 694: 158: 283:α, the opacity value of the foreground pixel. (α = 1 for an opaque foreground, α = 0 for a completely transparent foreground). A monochrome 262:
from the corresponding pixels from the two input images and recording the result in a third image, which is called the composited image.
788: 823: 46: 17: 955: 945: 687: 659: 628:. Proceedings of the 2014 Indian Conference on Computer Vision Graphics and Image Processing, ACM New York, NY, USA. 489:
There are two radically different digital compositing workflows: node-based compositing and layer-based compositing.
211: 198: 180: 110: 60: 151: 524:. Nodes are a great way to organize the effects in a complex shot while maintaining a grip on the smaller details. 640: 833: 950: 712: 680: 529: 874: 445:), the commutativity of a compositing operator can still be exploited to speed up computation through 576: 141: 940: 441:
If all layers of an image change regularly but many layers still need to be composited (such as in
413:
By simply rewriting the mathematical expression, one can save 50% of the multiplications required.
145: 137: 52: 474: 446: 493: 162: 909: 596: 442: 88: 884: 586: 538: 534: 8: 894: 768: 864: 813: 720: 556: 513: 288: 818: 778: 735: 655: 517: 505: 478: 431: 919: 783: 740: 629: 581: 251: 828: 521: 869: 859: 672: 591: 571: 296: 247: 235: 934: 914: 793: 760: 566: 470: 633: 623: 889: 838: 287:
where the pixel values are to be interpreted as alpha values is known as a
284: 621: 509: 497: 435: 427: 231: 561: 501: 458:
The most historically significant nonlinear compositing system was the
725: 543: 798: 745: 730: 648: 644: 347: 666: 879: 750: 351: 899: 459: 223: 611:
Simplified online digital compositor to create a photomontage.
230:
or screen display. It is the digital analogue of optical film
608: 463: 255: 254:
value, 'α', is used to control the proportions of two input
246:
The basic operation used in digital compositing is known as
492:
Node-based compositing represents an entire composite as a
227: 484: 622:
Mansi Sharma; Santanu Chaudhury; Brejesh Lall (2014).
83:
may be too technical for most readers to understand
625:Content-aware seamless stereoscopic 3D compositing 932: 702: 500:). Node-based compositing packages often handle 222:is the process of digitally assembling multiple 150:but its sources remain unclear because it lacks 647:, "Compositing Digital Images", Proceedings of 688: 654:The Art and Science of Digital Compositing ( 226:to make a final image, typically for print, 61:Learn how and when to remove these messages 695: 681: 258:values that end up a single output pixel. 215:Four images assembled into one final image 199:Learn how and when to remove this message 181:Learn how and when to remove this message 111:Learn how and when to remove this message 95:, without removing the technical details. 667:Node Based Compositing Explained(Video)" 210: 789:Autodesk Inferno, Flame and Flint (IFF) 416: 14: 933: 485:Node-based and layer-based compositing 676: 93:make it understandable to non-experts 122: 67: 26: 24: 615: 25: 967: 602: 42:This article has multiple issues. 915:Silicon Grail's RAYZ and Chalice 469:Compositing often also includes 127: 72: 31: 50:or discuss these issues on the 241: 13: 1: 295:Then, considering all three 7: 550: 453: 10: 972: 956:Film and video terminology 946:Film and video technology 852: 759: 711: 577:Digital on-screen graphic 275:a composited adetpixel, c 136:This article includes a 634:10.1145/2683483.2683555 265:Consider three pixels; 165:more precise citations. 494:directed acyclic graph 216: 597:Motion graphic design 443:distributed rendering 272:a background pixel, b 269:a foreground pixel, f 214: 951:Compositing software 885:Avid Elastic Reality 774:Left Angle Autograph 713:Free and open-source 587:Graphics coordinator 417:Algebraic properties 18:Compositing software 895:Avid Media Illusion 769:Adobe After Effects 704:Digital compositing 220:Digital compositing 910:Pinnacle Commotion 865:Autodesk Softimage 609:Digital Compositor 557:Broadcast designer 217: 138:list of references 928: 927: 665:Samuel Collett, " 518:Blackmagic Fusion 479:colour correction 432:additive blending 209: 208: 201: 191: 190: 183: 121: 120: 113: 65: 16:(Redirected from 963: 905:FXhome Lab Range 784:Autodesk 3ds Max 697: 690: 683: 674: 673: 637: 582:Gamma correction 204: 197: 186: 179: 175: 172: 166: 161:this article by 152:inline citations 131: 130: 123: 116: 109: 105: 102: 96: 76: 75: 68: 57: 35: 34: 27: 21: 971: 970: 966: 965: 964: 962: 961: 960: 941:Special effects 931: 930: 929: 924: 848: 755: 707: 701: 651:'84, 18 (1984). 618: 616:Further reading 605: 553: 487: 456: 419: 408: 404: 400: 396: 390: 386: 382: 378: 372: 368: 364: 350:artifacts (or " 342: 338: 334: 328: 324: 320: 314: 310: 306: 297:colour channels 244: 234:. It’s part of 228:motion pictures 205: 194: 193: 192: 187: 176: 170: 167: 156: 142:related reading 132: 128: 117: 106: 100: 97: 89:help improve it 86: 77: 73: 36: 32: 23: 22: 15: 12: 11: 5: 969: 959: 958: 953: 948: 943: 926: 925: 923: 922: 917: 912: 907: 902: 897: 892: 887: 882: 877: 875:Aviary Peacock 872: 870:Autodesk Toxik 867: 862: 860:Autodesk Smoke 856: 854: 850: 849: 847: 846: 841: 836: 831: 826: 821: 816: 811: 806: 804:FXhome HitFilm 801: 799:CompTime (ILM) 796: 791: 786: 781: 776: 771: 765: 763: 757: 756: 754: 753: 748: 743: 738: 733: 728: 723: 717: 715: 709: 708: 700: 699: 692: 685: 677: 671: 670: 663: 652: 638: 617: 614: 613: 612: 604: 603:External links 601: 600: 599: 594: 592:Motion graphic 589: 584: 579: 574: 572:Digital cinema 569: 564: 559: 552: 549: 486: 483: 455: 452: 418: 415: 411: 410: 406: 402: 398: 394: 391: 388: 384: 380: 376: 373: 370: 366: 362: 344: 343: 340: 336: 332: 329: 326: 322: 318: 315: 312: 308: 304: 293: 292: 277: 276: 273: 270: 248:alpha blending 243: 240: 207: 206: 189: 188: 146:external links 135: 133: 126: 119: 118: 80: 78: 71: 66: 40: 39: 37: 30: 9: 6: 4: 3: 2: 968: 957: 954: 952: 949: 947: 944: 942: 939: 938: 936: 921: 918: 916: 913: 911: 908: 906: 903: 901: 898: 896: 893: 891: 888: 886: 883: 881: 878: 876: 873: 871: 868: 866: 863: 861: 858: 857: 855: 851: 845: 844:Vegas Effects 842: 840: 837: 835: 832: 830: 827: 825: 822: 820: 817: 815: 812: 810: 807: 805: 802: 800: 797: 795: 794:Autodesk Maya 792: 790: 787: 785: 782: 780: 777: 775: 772: 770: 767: 766: 764: 762: 761:Closed-source 758: 752: 749: 747: 744: 742: 739: 737: 734: 732: 729: 727: 724: 722: 719: 718: 716: 714: 710: 705: 698: 693: 691: 686: 684: 679: 678: 675: 668: 664: 661: 660:0-12-133960-2 657: 653: 650: 646: 642: 639: 635: 631: 627: 626: 620: 619: 610: 607: 606: 598: 595: 593: 590: 588: 585: 583: 580: 578: 575: 573: 570: 568: 567:Digital asset 565: 563: 560: 558: 555: 554: 548: 545: 540: 536: 531: 525: 523: 519: 515: 511: 507: 503: 499: 495: 490: 482: 480: 476: 472: 467: 465: 461: 451: 448: 444: 439: 437: 433: 429: 423: 414: 392: 374: 360: 359: 358: 355: 353: 349: 330: 316: 302: 301: 300: 298: 290: 286: 282: 281: 280: 274: 271: 268: 267: 266: 263: 259: 257: 253: 249: 239: 237: 233: 229: 225: 221: 213: 203: 200: 185: 182: 174: 171:December 2009 164: 160: 154: 153: 147: 143: 139: 134: 125: 124: 115: 112: 104: 94: 90: 84: 81:This article 79: 70: 69: 64: 62: 55: 54: 49: 48: 43: 38: 29: 28: 19: 900:Kodak Cineon 890:Avid Matador 853:Discontinued 839:SilhouetteFX 779:Apple Motion 703: 624: 537:and limited 526: 491: 488: 468: 457: 440: 424: 420: 412: 356: 345: 294: 285:raster image 278: 264: 260: 245: 238:processing. 219: 218: 195: 177: 168: 157:Please help 149: 107: 98: 82: 58: 51: 45: 44:Please help 41: 809:Saber (ILM) 481:of images. 447:parallelism 436:associative 428:commutative 369:+ (1 − α) b 339:+ (1 − α) b 325:+ (1 − α) b 311:+ (1 − α) b 250:, where an 242:Mathematics 232:compositing 163:introducing 935:Categories 562:Chroma key 502:keyframing 475:retouching 430:, such as 101:April 2012 47:improve it 726:Cinelerra 641:T. Porter 544:flowchart 498:composite 53:talk page 746:OpenShot 731:Kdenlive 706:software 649:SIGGRAPH 551:See also 530:rendered 454:Software 348:aliasing 880:Avid DS 834:Piranha 824:Mistika 814:Houdini 751:Shotcut 721:Blender 645:T. Duff 514:Blender 471:scaling 352:jaggies 252:opacity 159:improve 87:Please 819:Fusion 736:Natron 669:(2023) 658:  520:, and 506:Natron 460:Cineon 401:+ α (f 224:images 920:Shake 741:Olive 510:Shake 464:Kodak 387:− α b 379:= α f 365:= α f 335:= α f 321:= α f 307:= α f 289:matte 279:and 256:pixel 144:, or 829:Nuke 656:ISBN 643:and 522:Nuke 477:and 630:doi 405:− b 397:= b 395:out 383:+ b 377:out 363:out 236:VFX 91:to 937:: 539:3D 535:2D 516:, 512:, 508:, 473:, 407:in 403:in 399:in 389:in 385:in 381:in 371:in 367:in 148:, 140:, 56:. 696:e 689:t 682:v 662:) 636:. 632:: 409:) 393:c 375:c 361:c 341:b 337:b 333:b 331:c 327:g 323:g 319:g 317:c 313:r 309:r 305:r 303:c 291:. 202:) 196:( 184:) 178:( 173:) 169:( 155:. 114:) 108:( 103:) 99:( 85:. 63:) 59:( 20:)

Index

Compositing software
improve it
talk page
Learn how and when to remove these messages
help improve it
make it understandable to non-experts
Learn how and when to remove this message
list of references
related reading
external links
inline citations
improve
introducing
Learn how and when to remove this message
Learn how and when to remove this message

images
motion pictures
compositing
VFX
alpha blending
opacity
pixel
raster image
matte
colour channels
aliasing
jaggies
commutative
additive blending

Text is available under the Creative Commons Attribution-ShareAlike License. Additional terms may apply.