Lightfield Studio

Bring your videos to life by converting them into Lightfield videos optimized for LitByLeia devices.

Beta Version

Getting Started

Lightfield Studio is a tool for video professionals and creators which helps you convert and master Lightfield video content. You can share Lightfield videos by sending them to other owners of LitByLeia devices or by sharing them with the community on LeiaStream by submitting mastered videos on the LeiaStream submission portal at LeiaStream.com.

Lightfield Studio: Beta Version has three core features:

  1. Orbital Content Conversion

  2. Stereo Content Conversion

  3. 2D Content Conversion

NOTE: H.264 or H.265 encoded video, AAC encoded audio in MP4 container supported. A resolution of at least 1280x720 is recommended.

Beta Recommendations

The following recommendations only apply to Lightfield Studio: Beta Version and may not apply in coming releases. Large performance improvements are expected in the next few versions of Lightfield Studio.

  • We recommend choosing input videos that are 30 frames per second.

  • We recommend choosing input videos that are between 720p and 1080p resolution.

  • We recommend using a computer with a recent Intel quad core processor. 8th generation or newer recommended.

  • We recommend using a computer with 16GB of RAM.

  • We recommend using a computer with a solid state drive (SSD).

Orbital Content Conversion

Orbital Content is any content that's captured around a subject. It can be from a series of pictures captured in a circular multi-camera array, or it can be captured by an aerial camera from a drone or other aircraft.

Input Filetype Supported:

  • MP4: A 2D video taken with a constant orbit around a stationary subject. The camera should remain parallel to the ground through the shot and speed should remain as constant as possible.

Export Filetype:

  • Quad Lightfield: Your converted output file will be an MP4 video in the Quad 4V Lightfield format, with _2x2.mp4 appended to the end of the filename.

Orbital Content Conversion Instructions:

1. Press the "Orbital Content Conversion" button on the left side of the window to select Orbital Content Conversion.

2. Browse and find the supported video file or just drag and drop it into the conversion window.

3. Adjust the FPS value to match the FPS of the input file. NOTE: if your output FPS doesn't match the input FPS, audio tracks may become out of sync or distorted. To identify your videos framerate, open it in QuickTime and press Command + i. 4. Select whether the content loops or not (the first frame of the video follows the last frame)

5. Select your Rotation as Clockwise or Counter-Clockwise, which identifies which direction the captured content is rotating in. 6. Choose what you'd like as a depth multiplier. This adjusts the final depth of the converted scene. If you choose to increase it, we recommend you keep the value between 1 and 2.

7. The tool then analyzes the content and applies conversion parameters before it begins to export your final output. Your output will be found at the filepath shown next to "Output:".

NOTE: For Orbital Content, we found that we were able to process 1.3 frames per second on a MacBook Pro with a 7th Generation Intel Core i7 quad-core processor, 16GB of RAM, and SSD storage. In one example, we were able to convert a 48 second clip with 1165 total frames in 14 minutes.

Stereo Content Conversion

Stereo Content is any 3D video content in a side-by-side format, commonly referred to as SBS in the 3D community.

Input Filetypes Supported:

  • 3D SBS MP4: A 3D video in an SBS format appended with _2x1.mp4 at the end of the filename.

  • H4V: A file extension used in the RED ecosystem for 3D video files.

Export Filetype:

  • Quad Lightfield: Your converted output file will be an MP4 video in the Quad 4V Lightfield format, with _2x2.mp4 appended to the end of the filename.

Stereo Content Conversion Instructions:

1. Press the "Stereo Content Conversion" button on the left side of the window to select Stereo Content Conversion.

2. Browse and find the 3D video file or just drag and drop it into the conversion window.

3. Choose what you'd like as the output FPS of your content. NOTE: if your output FPS doesn't match the input FPS, audio tracks may become out of sync or distorted. To identify your videos framerate, open it in QuickTime and press Command + i.

4. Adjust the Baseline Multiplier to fine tune the depth effect. We recommend to keep the value between 1 and 2. Learn more in the Baseline Multiplier Documentation Page.

5. Press the Start Conversion button in the middle of the window to begin your conversion.

6. Your converted output file will export and be found at the filepath noted next to "Output:".

Note: For Stereo Content, we found that we were able to process 0.8 frames per second on a MacBook Pro with a 7th Generation Intel Core i7 quad-core processor, 16GB of RAM, and SSD storage. In one example, we were able to convert a 2 minute and 19 second clip with 3334 total frames in 1 hour and 7 minutes.

2D Content Conversion

2D content is simply any standard video from a traditional camera, smartphone, or clip from a movie. Leia's advanced computer vision algorithms in Lightfield Studio will add depth to your video and make it a Lightfield video.

Input Filetype Supported:

  • MP4: Any standard video file. Lightfield Studio supports resolutions up to 4K and frame rates up to 120fps.

Export Filetype:

  • Quad Lightfield: Your converted output file will be an MP4 video in the Quad 4V Lightfield format, with _2x2.mp4 appended to the end of the filename.

2D Content Conversion Instructions:

1. Press the "2D Content Conversion" button on the left side of the window to select 2D Content Conversion.

2. Browse and find the video file or just drag and drop it into the conversion window.

3. Select the input FPS of the video you'd like to convert. NOTE: if your input FPS doesn't match the FPS you select, audio tracks may become out of sync or distorted. To identify your videos framerate, open it in QuickTime and press Command + i.

4. Choose what you'd like as a depth multiplier from 1 to 100, affecting the final depth of the scene.

5. Press the Start Conversion button in the middle of the window to begin your conversion.

6. Your converted output file will export and be found at the filepath noted next to "Output:".

Note: For 2D Content, we found that we were able to process 1 frame per second on a MacBook Pro with a 7th Generation Intel Core i7 quad-core processor, 16GB of RAM, and SSD storage. In one example, we were able to convert a 5 minute and 39 second clip with 10159 total frames in 2 hours and 58 minutes.

Transferring Files between Desktop and your Lume Pad

To transfer video files to or from your Lume Pad, download the Android File Transfer utility for MacOS from this link: Link to Download Android File Transfer

Connect the Lume Pad to your Mac using a USB-C cable and ensure the connection is set to the File Transfer mode on your device. You can select this by going to Settings -> Connected devices -> USB and then tapping on File Transfer.

Then you can use Android File Transfer to drag and drop converted files into the device's filesystem.

Feedback

We are excited for you to try Lightfield Studio: Beta Version and help us improve and add more features in the future. Please leave your feedback in the Lightfield Studio category on the LeiaLoft forum.