VuiPort is a user interface that incorporates machine video and machine control into one touch controlled panel and provides window like views of machining operations where a physical window is inappropriate or where additional/unobscured views are desired.
The video displayed by VuiPort can be consolidated from multiple video sources within the machine and spatially organized so the user can visually navigate around the work piece in real time using simple touch gestures to zoom, pan, rotate and orbit their position in relation to the work piece. The overlap between cameras is automatically incorporated into a 3D space and the UI switches to the present the most appropriate source depending on the user’s desired viewpoint. Lens distortion from wide/fish-eye lenses is automatically removed to provide a simulated pan, zoom, rotate and orbit all from fixed video sources with no moving parts.
VuiPort is typically controlled via a touch panel connected to the UI controller. The UI Controllers is a dedicated embedded computer that controls the User Interface, the video streams, its own camera network and access to the UI from the local network.
Each camera connected to the UI controller contains its own embedded processor. This provides an intelligent interface to the camera hardware over the camera network and limits the network traffic from cameras/areas that are not currently being viewed on a UI controller. The intelligent camera incorporates a small solid state disk and records a snapshot of the raw video collected by the camera.
If desired, automatic person/head/eye tracking can be incorporated with front facing camera(s) to enable automatic view adjustment based on a single onlooker’s position and proximity to the machine. This simulated “Window” onto the machine provides a realistic replacement for actual windows where these are impractical.
The machine tool position can be automatically tracked and the most appropriate video feed displayed whilst work is in progress. This feature can be used with the head tracking and touch control to set the user’s viewpoint so that the most important operations are observed.
VuiPort enables secure access from anywhere on the local network providing remote monitoring and control of a machine from any/multiple location(s) where desired. This interface is via a standard web browser and can be used from any operating system/device connected to the local network including PCs, tablets and smartphones. All operations performed on the machine, or remotely are securely controlled by authenticated access via username and password, RFID key/badge, fingerprint reader or a combination.
The video presented on the touch display can also be continuously recorded to solid state drive so that at any point in time, hours of machine operation may be viewed/copied/archived for reference. The duration of the recording is a function of the capacity of the storage attached to the UI controller.
In addition to recording the output displayed on the touch panel, it is possible to record all cameras simultaneously for historical playback and visual navigation of the entire view from all directions, the length of this recording is a function of the storage capacity and the resolution of the intelligent cameras.
VuiPort can display the machine control panel alongside the video so that the complete machine operation may be performed from a single touch user interface. This HMI can emulate various manufacturer’s standard HMI controls and screens so that the operator is presented with a familiar interface. As all various HMIs are interchangeable, an operator trained on one machine may use one from a different manufacturer by switching the UI to meet their needs, thereby reducing training time. In addition, when necessary, any facility or complex operation normally completed by a skilled machinist using the machine’s built in functions is presented directly to them and isn’t hidden behind a simplified UI. Less competent users may be limited by the functions available and introduced to the more complex tasks incrementally without a long training process. This enables the machine to be used by less skilled staff, but still be fully functional for more skilled staff.
Multiple VuiPort devices may be connected in parallel on one machine and their screens organized into a single integrated touch user interface. Elements of the user interface (such as the video window or the control panel) can be moved/organized between the various touch panels to suit the person using the machine or the operation in progress. Typically, these individual touch panels will be seen as one large touch panel behind a single sheet of glass. If preferred, a single large touch screen may be used, but there are benefits from both a cost and redundancy viewpoint of having multiple commodity screens acting in an orchestrated way to simulate one large display.
Where required, VuiPort can display the output from various CAD/CAM packages alongside the other controls for reference before and during operation. These documents/models may be navigated via the touch interface so that pertinent information is presented in a way appropriate to the work in hand.
Via the local network VuiPort can provide access to job planning and workflow documents directly on the user interface, this allows the user to organize, select and manage their work without leaving the control panel.
If desired, three dimensional models may be transparently overlaid onto or beside a workpiece in the video feeds to provide an integrated view of the model and the work in progress this model is presented in the three dimensional space of the work piece and can be visually navigated alongside the work using the same UI gestures. These models can be a simple as dimensional/tolerance notes/markup or as complex as a CAM animation synchronized with the machine operation.
The user may annotate the work in progress, these notes may take the form of keyed information or sketches drawn directly on the video feeds and may incorporate date-stamped recordings as well as live video. This facility can be used for design notes, rework, planning and QA. All notes and the associated video feeds, recorded machine settings, Job information and CAD/CAM model references can be digitally signed and saved together onto the network and remain part of the documented provenance for the work piece in relation to design feedback, process documentation and for quality, audit and regulatory purposes.
At any point, data collected from VuiPort controlled machines can be displayed on a central information “dashboard”. This facility provides real-time usage statistics and can be incorporated into a central display, standard reporting and/or in-house monitoring facilities. Choice of machines, the data presented and form (tabular, graphical, etc.) can all be simply configured. Status events based on guard conditions can automatically trigger messages via various electronic means (email, SMS, twitter) if required so that critical conditions or progress is notified to appropriate staff in a timely manner.