This page describes Homework 13 of CS491 - Virtual Reality and Augmented Reality
For this assigment we were supposed to choose a topic from the ones presented in the past week and write an evaluation of that topic. I choose the topic of "LightForm" by Talha Taj. The link to the official documentation of this topic can be found here: link
Lightform, as quoted by its creators is a design tool used for Projected Augmented Reality. This is done through the hardware device LF1 which ships with the purchase. LF1 works along with a projector and is built upon an A9 Quadcore Processor. The projector scans the surface in front by exposing a bright light at the figure at first followed by a series of bands of lights appearing which I am pretty sure are the part of scanning algorithm. Once the surface is scanned, one can use Lightform to add magical effects on the surface and the projector will project the frames on that surface. vAlright, I understood everything from the above lines, but how is it different from projection mapping.
Let us first understand whats exactly is Projection Mapping. Let me describe it in most simplest terms, Projection mapping is - a technology used to turn objects, often irregularly shaped, into a display surface for video projection.
Now, creators claim that the difference lies in the depth perception when this is compared to projection mapping. Lightform can detect the depth of the surface with respect to the background. I think this works in accordance with the Umbra-Penumbra shadows. When a bright light is projected on any of the surface, the surface appears bright and nothing can extract features from such a bright surface, except the feature of outlining and depth of that object in 3d space. This depth perception is used by Lightform to deply magical appearances on the surface.
One can disagree on the depth perception claims of the creators as they are just using one single camera in the LF1 to scan the surface and for the depth to be scanned we need stereoscopic vision. It turns out, when LF1 is attached to the projector, the camera of the LF1 is on the right while the projector lens is on the left. This accounts for stereoscopic vision necessary to scan depth percepttion.
Lets dive into the intricacies of this product and how it can be used in day to day activities.
Applications
The product undoubtedly have numerous number of applications in variety of domains such as, Entertainment, and Markteting to begin with. Products which require center of attraction at a store can be kept in an arranged spaces, surrounded by dummy objects which can be mapped using Lightform and can be brough to lives. The example of rain jacket advertisements on the webpage of Lightform is the perfect example for this tool's application in the advertisement sector. Another form of example can be allowing a car company to market their customizable product, For example a car which can be customized to different colors of windsheilds, rims and body. The car be projected with a series of different combination of available options. Lets talk about strengths and weaknesses of Lightform.
Strength
1. We dont need extra devices attached near our eyes to take the feel of augmentation.
2. The product comes in as complete kit needed to set the wheels in motion. i.e The hardware device LF1 and the software to create magical effects.
3. Third strength of the device is compatibility of the hardware with any projector.
4. Mapping technology used, uses the visible light unlike the traditional mapping technology where Infrared is used.
Weaknesses
1. The technology can only work on stationary objects. If the configured surface changes, then this changes the entire mapping and the only way out of it to reconfigure the mapping or bring back the object to its original position.
2. Entire process of mapping takes considerable amount of time inspite of A9 processor. This caps the mapping technology where it cannot be used where the mapping is required in realtime, like for the moving objects.
3. There is no inter projector communication possible until now, but I must say thats the next thing for the creators at Lightform.
Conclusion.
Even though its the most eye appealing technology, the most influencable domain for this product is Advertisement and Entertainment. If the creators can improve upon the mapping technology and map the moving surfaces in realtime along with inter assembly communication then we might have a car on streets which can change its color. To sum up the discussion, creators gotta still fill a lot of voids to make the product enter in other domains such as Education.