Goal

Build a low cost, semi-portable, planetarium style projection system that simultaneously collects spatial information via infrared for detection of objects, people, and fiduciary markers/reticles. Use this interface as the front end for an open Software Defined Radio communication platform that grows an open, decentralized, public mesh internet. Additionally the system can use it's spatial awareness for directional ultrasonic sound projection enabling targeted noise canceling and direct private communication in an open space.

Unit04

Projection

A short fat cylinder that has a convex mirror (the ideal appears to be a parabolic dew drop of a mirror) on the top and a laser projector on the bottom powered by a fairly robust 2D Microelectromechanical System (MEMS). The cylinder is covered by white SmartTint or similar Fast Switching Light Occlusion Material (FSLOM). Any fast switching occlusion material / smart glass should be evaluated as a possible solution. A FSLOM capable of controllable graduation could be very useful if that exists anywhere. SmartTint graduates from the outside edges of the material in which will effect Occlusion Oscillated Multi Dimensional Projection Mapping (OOMDPM). FSLOM and OOMDPM are terms of art created specifically for this project.

The system could potentially be mounted from the ceiling in the same place a rooms overhead light is normally mounted, this would provide power, easy install, as well as a top down throw to avoid projection collision with users eyes. The system could also be placed on a coffee table however the experience may not be ideal.

The bottom could also be a projection velum hemisphere that is not FSLOM creating a fishbowl projection surface. SmartTint will not work on hemispheres as far as I can tell as it is too thick and rigid. Spherical surfaces could potentially cause hot spots for the tint as well. Consult with SmartTint may provide a solution to this idea but the outside walls of the cylinder should provide enough coverage for spatial scanning to be effective. Other FSLOM may be moldable.

The light source is RGB+IR. IR potentially scans through SmartTint (untested) enabling IR scanning even when the FSLOM is opaque, there should be a scatter difference which can be used to adjust timing. If the chosen FSLOM also occludes IR it should still be effective to get mapping data during the transparent oscillation.

A fixed IR camera at the light source can be used to acquire a full spatial map of the room directly from the reflection source. This allows the system to map the room instantly as well as ensuring a safe and distraction free interactive experience.

The SmartTint can oscillate on and off faster than a human eye can see so a fishbowl projection at the center can be broadened out by projections on the walls. Wall projections can be mapped in real time automatically based on the detected planar and object surfaces in the room. The detected objects can then be occluded, dynamically lit and shadowed, or have appropriately transformed dynamic media projected on to them.

If through further testing no FSLOM is found suitably for MVP a tiered Laser/MEMS solution could be devised taking advantage of a single source routing the projected beam via fiberoptic cable. Leaving an upper rim of the system clear for projection at a steep angle and a lower module for internal and oscillated projection as well as spatial mapping of the room.

It may be ideal to have a very steep projection angle to the walls for a very bright system as well as safety systems in place for users approaching the projection path to avoid collision with users in motion. All laser projection systems should follow power and safety guidelines ensuring the user has an enjoyable experience and is never at risk of eye damage.

Radio Communication

The systems assets should be a Software Defined Radio (SRD) kit that is open to developers and users. Initial application should encourage mesh networking, file sharing, VoIP, and network bridging. The LimeSDR is a FOSS platform that provides all of it's hardware build files publicly however the production board will not be available until November 2016.

Sound

Ambisonics via speaker array # https://ccrma.stanford.edu/~njb/research/slorkSpeaker/
Ambisonics via Ultrasonic Transducer Array # http://www.biosono.com http://www.soundlazer.com
With directional microphones audio can be selective for users. Noise canceling ambient sounds or game sounds for individuals to whisper to them or noise canceling dialog from a single user so other users in the room cannot hear it.

Minimum Viable Product

TBD

Unknown Variables

FSLOM Occlusion Timing
FSLOM IR Interference Timing (Could potentially be used for calibration even if occluded.)
Clear FSLOM focal blur or distortion
Image Quality Tolerances

Potential Applications

Entertainment
Art Installation
Secure Communication
Industrial Simulation
Education / Training
Crowd Control
Home Security
Access Management / Identification
Emergency Information Distribution
Digital Signage
Teleconferencing
Advertising
Privacy Management
Home and Arcade Gaming
Event Broadcasting
Motion Capture

Radio Links & Sources

Complete Units

https://github.com/myriadrf # LimeSDR Github

Protocol

http://www.link-labs.com/what-is-lora/ # LoRa is a unique (and awesome) modulation format that can be generated by Semtech LoRa parts.
https://myriadrf.org/blog/lora-modem-limesdr/
https://www.lora-alliance.org/For-Developers/LoRaWANDevelopers # LoRaWAN is designed to provide Low Power Wide Area Network with features specifically needed to support low-cost, mobile, secure bi-directional communication for Internet of Things (IoT), machine-to-machine (M2M), and smart city, and industrial applications.