Archive for the ‘Workflow’ Category

Red offline/online Final Cut & Color workflow

So, I’ve decided to write up what’s fast becoming Nice Dissolve’s standard Red workflow, after finding about four different occasions on which to describe it over on Red User in the last week alone….

Workflow

  • On your transcoding/conforming machine (needs to be an Intel Mac), transcode R3D files to 720p ProRes SQ with the “quarter res” setting (“Draft” process in Redcine). You can do this from Redcine, Red Alert, Redline, Clipfinder, etc.
  • Edit with 720p files in Final Cut. These files can be pretty easily edited on just about any Mac hardware you’d consider running FCS2 on in the first place, including laptops or those old G5 towers you still have kicking around.
  • Back on your transcoding/conforming machine, export your edited sequence from Final Cut as XML. use Clipfinder to swap references to your ProRes files for references to _H proxies, and let Clipfinder change the resolution settings on your sequence to match. Import the newly generated XML file back into your FCP project. It will come in with the same name as your ProRes sequence, so rename it so you can tell them apart.
  • File -> Send To -> Color in Final Cut with your newly imported sequence.
  • Immediately save your Color project and close. Use the “looping bug” fixer in Clipfinder (in the Tools menu) on the project.
  • Re-open the Color project and grade.
  • Render out of Color to ProRes or Uncompressed HD and send project back to Final Cut for titling, etc. or render to DPX and handle further processing in After Effects, Shake, etc.

Notes

  • We typically use Redcine to export the ProRes files. It lays everything out on a timeline for you and makes it easy to do a quick one-light grade.
  • When transcoding your ProRes files, make sure they have the same names as your R3D files (except, obviously, with a .mov extension rather than a .R3D extension). Redcine might add an extra underscore to the end of file names; use a script or batch renaming utility to get rid of it, or it will cause trouble when you try to conform. (If it’s already too late, then before you process your exported XML sequence though Clipfinder, open it in a text editor and do a search/replace of “_.mov” to “.mov”).
  • If you haven’t used Color before, be sure to read the section of the user guide that discusses its limitations when working with transitions, filters, still images, etc. from Final Cut timelines.

Analysis

This is basically my favorite low-cost Red workflow. It’s the first commodity-software workflow that, in my opinion really has all the essential pieces in place.

Pros:

  • Fully compressed (except possibly the final output, if you choose to output in an uncompressed format) — you could plausibly finish even a feature with just a couple of terabytes of storage and you don’t even really need a RAID array.
  • Transcoding to 720p files from a 1/4 resolution de-bayer is quick. It can be near real-time on a single 8-core Mac Pro.
  • 720p ProRes files are very lightweight, only a little more than twice the data rate of DV, making it easy to take projects with you. Edit on your laptop, conform on the Mac Pro back at the office.
  • FCP on just about any modern Mac is very responsive while editing 720p, unlike with the comparatively much heavier workload of editing R3D proxies.
  • You can do a quick one-light when creating the 720p files, so your editor can look at nicer footage than R3D proxies with whatever look metadata they happen to have.
  • You’re grading in an environment which provides access to the full range of the R3D data and also provides vastly more powerful color correction tools that Redcine or Red Alert.
  • Only the precise frames used in your final edit ever have to be transcoded at high-quality (happens when you render out of Color).
  • If you have a Mac Pro and set Color to quarter-resolution playback, you can even get real-time playback of R3D in color projects, at least if you don’t get too carried away with secondaries, and it doesn’t look terrible on a client monitor.
  • No messing around with Media Manager or Log & Transfer in Final Cut.
  • This workflow doesn’t require any software other than Red’s software (free), Clipfinder (donationware) and Final Cut Studio.

Cons:

  • Limited to 2K finish or below. (Then again, even most Hollywood features still aren’t finished above 2K.)
  • Footage is fed into Color via the equivalent of a “half res high” decode, not quite as good as decoding full 4K and scaling. (But good enough for almost any HD finish, in my opinion.)
  • Requires up-front transcoding, unlike R3D proxy-based workflow.
  • Because of decoding overhead, Color is not as responsive with R3D files as with uncompressed HD or DPX (if you have a RAID fast enough to handle those formats in real time).

New Red/Apple FCS workflow

The Pro Applications Update 2008-004 (run Software Update) and the Red Final Cut Studio 2 Installer provide access to two new major features.

The first is rewrapping R3D data into QuickTime files that Final Cut can work with natively, though Final Cut’s Log & Transfer interface. There’s some debate about this, but as far as I can tell it appears to simply create QuickTime movies that are the equivalent of the existing QT proxy files, but self contained. This isn’t actually all that useful. (Why not just use the proxies? Rewrapping all the same data is just going double the amount of disk space your project uses for no good reason.)

The second feature is far more significant. Previously if you did a ‘Send to Color’ in on a Final Cut sequence containing containing Red proxies, you got… nothing. You got a bunch of clips on a timeline in Color that Color couldn’t do anything with. After installing this update, not only do proxies (and the new QT-wrapped files) show up in Color, but Color has access to the full raw data.

This workflow lets you edit immediately without any up-front transcoding, only requires you to transcode the exact frames you use in your final edit (they get transcoded as the footage gets rendered out of Color), allows you to create anything up to a DPX or uncompressed HD final deliverable without any previous step requiring you to work with uncompressed data, and provides access to the full range of the raw image capture by the camera in a grading environment significantly more powerful than RedCine.

While other workflows have offered some of these benefits, this is the first workflow which offers all of them at commodity prices. (Previously only SCRATCH offered all of this, and not at commodity prices.)

Now, there are a few caveats:

  • As is fairly typical for this kind of dual-app edit/conform workflow, Color doesn’t render Final Cut video generators, filters, motion tab settings, or transitions other than dissolves. This isn’t as bad as it might sound, because these things aren’t typically used on feature film projects, and if you’re not editing a feature that’s being rendered to DPX, you can round-trip through Final Cut (do a ‘Send to Final Cut Pro’ in Color) and handle all of this back in Final Cut.

  • Color only supports up to 2K. No 4K finishing from this workflow. 2K comes in as 2K. 3K, rather awkwardly, comes in as 1.5K, which I think Final Cut’s real-time engine has some issues with.

  • I believe 4K footage through this workflow is rendered at the equivalent of the “half high” setting in Red’s other apps. It would be nice to have the option to have 2K scaled from a full 4K debayer as well.

  • This new software hasn’t yet been tested extensively with Build 18 footage, or formats other than 4K 2:1 and 2K 2:1. I’ll be doing some tests with 4KHD this week. 4KHD is going to be important to this workflow because 4K footage comes in at half its native resolution (see above), so if you want to finish in 1080p, shooting 4K HD will make your life easier.

The Red Final Cut Studio 2 Installer linked above comes with a 24 page whitepaper on Red FCS workflow that lays all of this out in much more detail, if you’re interested.

In defense of compression

There’s a certain demographic which seems to sit around thinking of reasons why the Red One can’t possibly be any good. We’ve all run across these arguments. One that has really been bugging me recently is the notion that RedCode compression somehow constitutes, essentially, cheating; that Red shouldn’t really be considered a high-end camera because it shoots compressed footage.

The notion that uncompressed is always better for a professional camera shows a complete lack of understanding of the trade-offs involved with this sort of decision. Sure, uncompressed is better if all other things are equal. But all other things aren’t equal.

What particularly annoys me is the notion that the Red One is somehow less professional than cameras which output uncompressed 1080p as their final product. Modern compression algorithms are extremely smart about what data they discard. The idea that you’re better off with an uncompressed image with a much smaller number of total pixels simply doesn’t hold up to even the most cursory analysis.

Even very low bit-rate consumer formats like HDV, when shooting HD, produce much better looking images than uncompressed SD, despite having far lower bit rates. (And HDV compression for 1080p footage is something like 85:1 or 90:1 compression. RedCode 28 is 12:1, and with a much more advanced algorithm.) You’re far better off capturing lots of detail and having a modern compression algorithm figure out what it can safely get rid of than you are capturing less detail in the first place, or capturing lots of detail but throwing lots of it away immediately using more primitive techniques like downscaling or subsampling chroma.

OK, so why doesn’t Red just record uncompressed 4K bayer, instead of compressed 4K bayer?

I’m quite confident in saying that given today’s technology, the Red One is a far more compelling product because of RedCode than it would be if it only shot uncompressed data. In fact, the camera wouldn’t be nearly as significant to the market if it didn’t shoot to a compressed format.

RedCode is what allows you to shoot to CF cards and Red Drives, rather than being tethered to a RAID the size of a mini-fridge. It’s what allows footage to be downloaded in a practical way on-set. It’s what allows you to play back footage from a single SATA or FireWire 800 hard drive, and store about 10 hours of footage per terabyte, instead of around 50 minutes.

Of course, you don’t get all of this for noting. The Red One probably could probably use less power and run cooler if it didn’t have to do 4K wavelet compression in real-time. And there is some loss of image quality vs. a totally uncompressed 4K image.

But the fact is, the Red One wouldn’t be a remotely practical camera for the vast majority of the projects it’s being used on, if Red had bought into the myth that professional recording must be uncompressed. RedCode is the major factor that makes the Red One usable by low-budget indies. Without RedCode, the data situation would simply be unmanageable for low-budget indies, both on-set and in post. Without Redcode this blog, which after all focuses on the technical issues surrounding low-budget indie filmmaking, probably wouldn’t talk about the Red One at all. As it is, that’s practically all we talk about….

Red releases first Build 16 firmware beta

We’re still here, we’ve just been rather busy. Regular updates should start again… about now.

See major new features and menu map. Camera owners can, of course, get it in the usual place.

The biggest enhancements are related to image quality. Red appears to have rather dramatically reduced compression artifacts and noise levels. 16:9 4K is also now far more practical to shoot and worth with, with the codec errors during recording supposedly fixed, and 16:9 4K QuickTime proxies now working.

Red has also introduced a new color space, REDSpace, that allows for better WYSIWYG exposure on-camera. Or, for those who work in a more technical way, you can now directly monitor raw, so you know exactly what the sensor is capturing.

Build 16 also introduces 1080p output in playback mode, though not for live monitoring, and many user interface conveniences and fix-ups, like user buttons that are now actually programmable, and the ability to adjust a range of parameters with the rotary encoder on the EVF.

Be warned, however, that Build 16 changes the format of R3D files. There are QuickTime plugins and RedAlert/RedLine builds for the new format, but not RedCine build that can work with Build 16 footage yet. So if your workflow relies on RedCine, you’ll probably want to hold off until that shows up (possibly as soon as next week).

Update: the Build 16 compatible version of Redcine has just been posted. Get it in the usual place.

Red Workflow Primer #2

This post is going to be a rundown of Red desktop workflow, and will look at both where it stands now and where it’s headed in the future. I had been holding off on this post in the in the hope that REDCINE would be released in time for me to discuss it a bit, but that seems to be taking awhile so I think I’ll just go ahead.

If you haven’t yet, read part one of the workflow primer, which discusses RAW acquisition and wavelet compression, both essential to the desktop workflow equation.

As things stand now, there are three ways to do something useful with Red footage, once you get it onto a computer. The first is to feed it into Assimilate’s SCRATCH, which has native support for REDCODE. I’ll discuss that workflow if I ever get a chance to play with a SCRATCH system for long enough to have anything useful to say about it. Until then, though, I’m going to focus on the other two methods of getting Red footage into apps in a usable format, and on where things are headed in the future.

1. Red Alert!

Red Alert! is Red’s interim RAW processing app. It’s sort of like Adobe Camera RAW, but for RED footage. One sets white balance, exposure, what curve to apply to the image (linear, Rec. 709) and all the other stuff one doesn’t have to set in-camera, because the camera is shooting RAW footage. Red even lets you tune the debayering algorithm, to get a smoother image or to try to extract more detail.

Red Alert! can review footage with the chosen settings and (this is the important bit) render it in a couple of ways, at 2K or 4K. If you’re feeding your footage into a traditional DI pipeline, you can render out DPX or TIFF files. A TIFF or DPX file stream, though, will run around at least a couple of hundred megabytes a second, though, and that’s at 2K, which makes this workflow a little heavy for anyone without a fairly serious post budget. So, this post (and this blog, for that matter) is going to focus a bit more on the other workflow.

2. The REDCODE QuickTime codec

RED has another way to get footage into apps in a usable format, one that’s relatively undeveloped now, but will probably be the anchor of low-budget in the future. Red has developed a QuickTime component which understands REDCODE. The camera, of course, doesn’t record directly into QuickTime files, but the Red QuickTime component works around that in a neat way: QuickTime reference movies. What are QuickTime reference movies? They’re tiny MOV files that simply contain some metadata, and a pointer to a Red footage file (a .r3d file). These reference files are generated automatically by the camera with recent firmware builds. One can also generate them in Red Alert!, in which case they’ll reflect the RAW processing settings one has chosen in Red Alert! The camera and Red Alert! generate reference movies for multiple resolutions, so you can feed 2K, 1K or 0.5K into QuickTime apps.

This approach allows one to work with REDCODE data without having to recompress it or convert it to formats that take up much more space. And, of course, since you’re working directly on the original RAW data, you have access to everything the camera captured (more on that later).

It does presently have some limitations, however. REDCODE is an acquisition codec, and optimized with that in mind. It’s intended to provide maximum quality at a given bit rate. Unlike, say, Apple’s ProRes, it’s not designed to be light on your editing system. One needs a fairly fast system to back the 1K reference movies in real-time, and I haven’t heard reports of the 2K versions playing back reliably in real-time even on very high-end machines (contact me if you’ve heard differently).

Another limitation is that the QuickTime proxies currently can’t spit out 4K at all, and they use a lower quality debayering algorithm than the best Red Alert! has to offer.

Finally, one can’t really edit directly with REDCODE footage at the moment using the QuickTime reference movies. REDCODE RAW is read-only (it makes sense that you can’t render out in a RAW format), so you can’t set REDCODE as the codec of a Final Cut Pro timeline. This means you have to drop REDCODE footage into an FCP timeline set to use another codec… which means you have to render everything before playing it back.

The good news is, it’s probable that all of these issues will disappear as the workflow matures. More code optimization (and, of course, the ever-increasing speed of computers) will no doubt make real-time 2K (and even 4K) playback of REDCODE footage a reality on the desktop. Red will almost certainly offer more options for how to decode data though QuickTime reference movies, allowing this pipeline to be used for everything form low-quality previews, for full-quality 4K footage to be feed into compositing programs, etc. And, of course, native REDCODE support has been promised in a future version of Final Cut. Presumably this last will require a version of the REDCODE codec that has been modified to support encoding (I would guess to an RGB variant of REDCODE which can be mixed with REDCODE RAW footage in a timeline).

As this workflow matures, it should be possible to do an offline edit with real-time performance (but from reference movies — so there’s no need to waste lots of space and render time on separate proxy files), and then go back and do a full-quality conform, by swapping out one set of QuickTime reference movies for another.

Until that day comes, the QuickTime proxy movies still provide a fast way to convert Red footage into other formats, like ProRes, so one can offline (or even online, for many deliverables) in those formats. This function of QuickTime proxy movies should become obsolete when REDCINE ships, however, as it will be able to directly export to different QuickTime formats, and should offer more options when doing so (like full quality debayer).

Just to clear up one common misconception — Final Cut Pro will not be limited to 8-bit when working with REDCODE footage. Yes, Final Cut only does 8-bit for RGB. However, it offers a full 32-bit 4:4:4 YUV pipeline. A codec can work around the 8-bit limitation for RGB by simply appearing to FCP as a YUV codec — and Gramme Nattress has mentioned in several places that Red’s QuickTime component does precisely this.

I should have a post later in the week about what a practical low-budget indie workflow for RED footage would look like as things stand right now.