Archive for the ‘Red’ Category

Red offline/online Final Cut & Color workflow

So, I’ve decided to write up what’s fast becoming Nice Dissolve’s standard Red workflow, after finding about four different occasions on which to describe it over on Red User in the last week alone….

Workflow

  • On your transcoding/conforming machine (needs to be an Intel Mac), transcode R3D files to 720p ProRes SQ with the “quarter res” setting (“Draft” process in Redcine). You can do this from Redcine, Red Alert, Redline, Clipfinder, etc.
  • Edit with 720p files in Final Cut. These files can be pretty easily edited on just about any Mac hardware you’d consider running FCS2 on in the first place, including laptops or those old G5 towers you still have kicking around.
  • Back on your transcoding/conforming machine, export your edited sequence from Final Cut as XML. use Clipfinder to swap references to your ProRes files for references to _H proxies, and let Clipfinder change the resolution settings on your sequence to match. Import the newly generated XML file back into your FCP project. It will come in with the same name as your ProRes sequence, so rename it so you can tell them apart.
  • File -> Send To -> Color in Final Cut with your newly imported sequence.
  • Immediately save your Color project and close. Use the “looping bug” fixer in Clipfinder (in the Tools menu) on the project.
  • Re-open the Color project and grade.
  • Render out of Color to ProRes or Uncompressed HD and send project back to Final Cut for titling, etc. or render to DPX and handle further processing in After Effects, Shake, etc.

Notes

  • We typically use Redcine to export the ProRes files. It lays everything out on a timeline for you and makes it easy to do a quick one-light grade.
  • When transcoding your ProRes files, make sure they have the same names as your R3D files (except, obviously, with a .mov extension rather than a .R3D extension). Redcine might add an extra underscore to the end of file names; use a script or batch renaming utility to get rid of it, or it will cause trouble when you try to conform. (If it’s already too late, then before you process your exported XML sequence though Clipfinder, open it in a text editor and do a search/replace of “_.mov” to “.mov”).
  • If you haven’t used Color before, be sure to read the section of the user guide that discusses its limitations when working with transitions, filters, still images, etc. from Final Cut timelines.

Analysis

This is basically my favorite low-cost Red workflow. It’s the first commodity-software workflow that, in my opinion really has all the essential pieces in place.

Pros:

  • Fully compressed (except possibly the final output, if you choose to output in an uncompressed format) — you could plausibly finish even a feature with just a couple of terabytes of storage and you don’t even really need a RAID array.
  • Transcoding to 720p files from a 1/4 resolution de-bayer is quick. It can be near real-time on a single 8-core Mac Pro.
  • 720p ProRes files are very lightweight, only a little more than twice the data rate of DV, making it easy to take projects with you. Edit on your laptop, conform on the Mac Pro back at the office.
  • FCP on just about any modern Mac is very responsive while editing 720p, unlike with the comparatively much heavier workload of editing R3D proxies.
  • You can do a quick one-light when creating the 720p files, so your editor can look at nicer footage than R3D proxies with whatever look metadata they happen to have.
  • You’re grading in an environment which provides access to the full range of the R3D data and also provides vastly more powerful color correction tools that Redcine or Red Alert.
  • Only the precise frames used in your final edit ever have to be transcoded at high-quality (happens when you render out of Color).
  • If you have a Mac Pro and set Color to quarter-resolution playback, you can even get real-time playback of R3D in color projects, at least if you don’t get too carried away with secondaries, and it doesn’t look terrible on a client monitor.
  • No messing around with Media Manager or Log & Transfer in Final Cut.
  • This workflow doesn’t require any software other than Red’s software (free), Clipfinder (donationware) and Final Cut Studio.

Cons:

  • Limited to 2K finish or below. (Then again, even most Hollywood features still aren’t finished above 2K.)
  • Footage is fed into Color via the equivalent of a “half res high” decode, not quite as good as decoding full 4K and scaling. (But good enough for almost any HD finish, in my opinion.)
  • Requires up-front transcoding, unlike R3D proxy-based workflow.
  • Because of decoding overhead, Color is not as responsive with R3D files as with uncompressed HD or DPX (if you have a RAID fast enough to handle those formats in real time).

Will RedRay usher in the age of consumer 4K?

My guess is, probably not.

The computer industry will certainly push for higher resolution displays, mostly because ~200 dpi allows for vastly better text rendering. I tend to think that the technology will be in place for reasonably priced consumer 4K within the next four years or so, but that there really won’t just be much consumer demand. You have to sit almost comically close to a 50″ TV before you start wishing you had more detail than 1080p provides. Consumer 4K stands a good chance of ending up like SACD and DVD Audio; most people thought CDs were more than good enough, so these formats went nowhere. In fact, the formats that eventually did largely replace the CD — MP3 and AAC — were [I]lower[/I] quality, but more convenient.

Maybe if TVs keep getting bigger… but I think they may already be large enough that most people don’t really want something bigger in their living rooms, so there might have to be some big change in technology for that to happen. (“Screen paint” that turns walls into screens or something. Give it 20 years.)

Now, maybe I’m wrong about all this, and consumer 4K will be the big summer hit of 2014. But I suspect if Red wants to make a play for the mainstream consumer distribution market, what they should do is develop a version of the RedRay codec optimized for 1080p Internet streaming. If what happened with music is any guide, Blu-ray won’t be replaced by a higher quality physical media format, but by a substantially more convenient (and possibly somewhat lower quality) downloadable and streamable format.

I see RedRay’s primary use being on Red productions, in Red post facilities, on the festival circuit, in art house theaters and other indie venues, and possibly for wider theatrical use if it supports some sort of copy protection.

RedRay: is that really possible?

Red unexpectedly demoed the RedRay, their 4K player, to an unsuspecting audience at the recent Red Party in Las Vegas. I, unfortunately, was on the other side of the country, but reports are the results were impressive.

The player can output 4K, 2K and 1080p. The Red demo was a reel (material shot on the Red One, of course) compressed with a new RGB codec designed for the RedRay, with a data rate of just 10 Mb/s. That’s 4K at 1/3 of the bit rate of a typical Blu-ray disc, which would be a substantial advance in compression technology. Sufficiently substantial that there has been a fair bit of skepticism about it, in fact.

I’d like to address a bit of that here. As I pointed out in this post over on Cinematography.com, while the advances embodied in RedRay are quite impressive, they’re technically plausible. Blu-ray runs at around 30 Mb/s, but this is mostly because it can; Blu-ray discs offer room to spare. Respectable 1080p video can be delivered with the H.264 codec at as little as 10 or 11 Mb/s. See Apple’s trailer site for many examples. 4K is around 4x the number of pixels of 1080p (just a little more, actually), so this means Red’s new codec is perhaps 4x as efficient. That’s about the same improvement factor that H.264 offers over MPEG-2, the codec for standard-definition DVD. The upshot is, we’ve seen codec improvements on this scale before.

There is, of course, no such thing as a free lunch. And in the case of dramatically improved video quality at a given bit rate, the cost comes in the form of computational overhead. H.264 requires much more processing power to decode than MPEG-2, and I suspect that the RedRay codec requires so much that real-time software decoding will be impossible for the next several years, and you’ll have to use a dedicated hardware device with an appropriate ASIC (a specialized processor) to play the footage.

Fortunately, the RedRay, which is precisely such a device, is supposedly going to be priced under $1000, making it a very handy tool for Red productions and post facilities, and probably of considerable interest on film festival circuits and to art house theaters.

Your regular installment of Red myth debunking

The amount of fear mongering and disinformation in this thread is pretty astounding.

We have Red #404. We got it February, and have shot quite a lot with it. I’m with the camera virtually every time it’s used.

I’ve never seen the camera overheat.

I’ve never seen a Red Drive drop a frame, even in fairly jarring handheld use. We had a shoot a couple of months ago with the operator basically running through the bottom floor of a house doing whip pans — no frames dropped over about 20 takes. About a month ago we were using the camera handheld on-stage at a rock concert. I was keeping a close eye on the frame drop readout because sound becomes a real physical force at those intensity levels, but the drives held up fine. Red Drives are known to drop frames when there’s substantial mechanical vibration, such as with vehicle mounts. The simple solution is to not use them in those applications. It’s not as if Red doesn’t provide alternative recording mechanisms.

I have seen occasional boot failures — maybe one in 20 times the camera will freeze during boot. But you can tell that it’s frozen about 10 seconds into the boot process, and a quick power cycle resolves the issue. Total time lost, maybe 15 seconds.

As far as workflow goes… there have been perfectly workable Red workflows from the beginning. If you’re finishing in an HD video format, a $3500 Mac Pro tower can convert 4K Red footage to 1080p ProRes, DNxHD or uncompressed video at a rate of about three hours per hour of footage using the “Half Res High” decoding mode (which I believe is the same thing as “Standard” decoding in RedCine). On most shots this is nearly indistinguishable from doing a 4K debayer and downscaling, except that it’s about four times as fast.

Three hours per hour of footage means that you have your footage in online quality by the next morning.

For DI-style workflows, 2K DPX transcoding takes about the same amount of time (assuming you’re writing out to disks fast enough to write about 8 2K DPX frames per second — which isn’t all that hard these days).

A 4K DPX transcode might be more like 12 hours per hour of footage, but hey, two frames a second is, as far as I’m aware, a lot faster than any 4K film scanner in the world. And you could build a commodity hardware cluster which could do such transcodes in real-time for under $50K, probably, if you were so inclined, which is rather less than a 4K film scanner.

There are, of course, post houses which will provide these transcoding services if you don’t want to keep the infrastructure in-house. Though it would be a little silly for an individual or organization working with footage from high-end cameras to not keep a recent-model workstation in at least the $4000 range kicking around.

And, you can, of course, work with the footage on any Intel Mac (any Intel Mac with non-integrated graphics, for RedCine). You probably don’t want to transcode hours of footage on an iMac, but there’s nothing stopping you. And a MacBook Pro is pretty standard equipment on Red sets of checking footage on-set. You can play back 4K as 1K and output full-resolution stills. And play with one-light grades in real-time in RedCine to check if you can push the footage the way you want to.

The reason there’s so much discussion about Red workflow isn’t because there’s no practical workflow. It’s for two reasons.

One is that, because the model for the camera is to shoot in a proprietary format and then transcode, and because the camera is used for a wide range of productions, there is no one obvious workflow. This isn’t DVCPRO HD, where the standard workflow is to capture tapes (or download cards) and drop into Final Cut. You might want an HD workflow (compressed or uncompressed), or a DI workflow. You might want an offline or an online workflow. You might be happy with a workflow that requires you to transcode all the footage you shoot, or one that only requires you to transcode the shots you use in the final edit, or maybe only with one that only requires you to transcode the specific frames you use in the final edit. All of these, in many combinations, are possible, and they have different implications for quality, cost, and technical ability.

The second reason Red workflow gets discussed so much is because a lot of people aren’t happy with traditional HD and DI workflows, when they can see that Red’s compressed raw capture makes something better possible.

If you just transcode all of your footage to an HD video format, you lose the full range of the raw files before you’ve even started. You can do some grading in RedCine before you convert, but RedCine is pretty far from being a fully-featured grading environment.

You can mostly avoid this problem by transcoding to 10-bit (log) DPX or 16-bit (linear) TIFF, but workflows based around those formats require tens of terabytes of very fast storage and many commodity-priced software tools can’t work with them, so costs can quickly escalate to traditional DI levels as soon as you start to go this route.

What many people have been waiting for is the ability to work with all the data in those compressed raw files without having to transcode them into an unwieldy uncompressed format before feeding them into editing and grading tools. This has taken a lot longer to emerge than I think some people expected, which may have more to do with third-party vendors than Red itself, but has nonetheless been unfortunate for Red’s customers.

But in the last couple of months — last couple of weeks, for Final Cut — we’ve finally started to see this.

As of a couple of weeks ago, after I edit 1K or 2K proxy files (of 4K footage) in Final Cut Pro (an old capability), I can then send the edit to Color (the Final Cut Studio grading app), grade in a fairly capable environment with full access to all the data in the raw file, and then render out in any format up through 2K DPX.

And while it’s certainly nicer to do this on a $5000 8-core Mac Pro at the office, I can also do this on my $2000 laptop. I could do it on a $1200 iMac. With no external disks other than consumer-priced external FireWire 800 drives. And no software other than Red’s free tools and Apple’s $1299 Final Cut Studio.

It’s now not at all implausible to take a feature through the editing, grading and conforming processes, ending up with a 2K DPX conform, with less than $10K worth of hardware and software.

That’s the workflow everyone has been waiting for. And while there’s still room for quite a bit of refinement, it’s here now on the Mac with Final Cut, and while I haven’t kept such close tabs on the Adobe side of things, I gather things are moving along there as well (on both platforms).

New Red/Apple FCS workflow

The Pro Applications Update 2008-004 (run Software Update) and the Red Final Cut Studio 2 Installer provide access to two new major features.

The first is rewrapping R3D data into QuickTime files that Final Cut can work with natively, though Final Cut’s Log & Transfer interface. There’s some debate about this, but as far as I can tell it appears to simply create QuickTime movies that are the equivalent of the existing QT proxy files, but self contained. This isn’t actually all that useful. (Why not just use the proxies? Rewrapping all the same data is just going double the amount of disk space your project uses for no good reason.)

The second feature is far more significant. Previously if you did a ‘Send to Color’ in on a Final Cut sequence containing containing Red proxies, you got… nothing. You got a bunch of clips on a timeline in Color that Color couldn’t do anything with. After installing this update, not only do proxies (and the new QT-wrapped files) show up in Color, but Color has access to the full raw data.

This workflow lets you edit immediately without any up-front transcoding, only requires you to transcode the exact frames you use in your final edit (they get transcoded as the footage gets rendered out of Color), allows you to create anything up to a DPX or uncompressed HD final deliverable without any previous step requiring you to work with uncompressed data, and provides access to the full range of the raw image capture by the camera in a grading environment significantly more powerful than RedCine.

While other workflows have offered some of these benefits, this is the first workflow which offers all of them at commodity prices. (Previously only SCRATCH offered all of this, and not at commodity prices.)

Now, there are a few caveats:

  • As is fairly typical for this kind of dual-app edit/conform workflow, Color doesn’t render Final Cut video generators, filters, motion tab settings, or transitions other than dissolves. This isn’t as bad as it might sound, because these things aren’t typically used on feature film projects, and if you’re not editing a feature that’s being rendered to DPX, you can round-trip through Final Cut (do a ‘Send to Final Cut Pro’ in Color) and handle all of this back in Final Cut.

  • Color only supports up to 2K. No 4K finishing from this workflow. 2K comes in as 2K. 3K, rather awkwardly, comes in as 1.5K, which I think Final Cut’s real-time engine has some issues with.

  • I believe 4K footage through this workflow is rendered at the equivalent of the “half high” setting in Red’s other apps. It would be nice to have the option to have 2K scaled from a full 4K debayer as well.

  • This new software hasn’t yet been tested extensively with Build 18 footage, or formats other than 4K 2:1 and 2K 2:1. I’ll be doing some tests with 4KHD this week. 4KHD is going to be important to this workflow because 4K footage comes in at half its native resolution (see above), so if you want to finish in 1080p, shooting 4K HD will make your life easier.

The Red Final Cut Studio 2 Installer linked above comes with a 24 page whitepaper on Red FCS workflow that lays all of this out in much more detail, if you’re interested.