FRDCSA

ProblemSpace

Brief: Operations management real-time strategy system
Jump To: Parent Description
Code: GitHub

  • One technique under consideration is using Alice and the Sammon mapping to procure a visualization of the problem space as exported by various systems. In this way we wish to visualize who is accomplishing what task.

    At the technical level, there is a major component gimmick, integrating emacs cyc-mode with unilang monitoring and clear user knowledge models results in a high-level symbolic VR (that is not physically based) to provide an abstract and contingent knowledge manipulation and execution monitoring environment for FRDCSA analysts. Using the popular Matrix interface is a natural start for this project.

    I wrote this emacs code (in 2 hours by copying and making small changes to zone.el) primarily for a few reasons:

    • The Matrix science fiction world is very popular and I'm hoping to increase interest in the FRDCSA.
    • By association we quickly convey many of the definite parallels between Matrix concepts and our project - for instance the similarity between the svre and the Construct.
    • The svre requires a powerful interface within emacs and this is a natural starting point.

    Note that the streaming texts are actually opencyc axioms judged relevant by audience to the operator/analyst and summarize events, including inferences drawn from sensor data. Sensors generally mean subsystems such as a SLAM vision based navigation system, a face recognition system, voice recognition, etc. In that sense this is extremely similar to the original Matrix visualization in terms of their correspondence to the environment.

    So, for instance here are some examples of Situations and plausible content.

    You left a given room and VSLAM detected this. (#$departed #$AndrewDougherty #$Wean-4326)
    You left your computer and the face recognizer noticed your face was no longer in field of view. (#$leftFOV #$WebCamera1280 #$AndrewDougherty)
    You said something into your microphone. (#$speechAct #$AndrewDougherty "Where are my cable ties?")
    While spidering, radar and architect discovered a system that implements important capabilities. (#$located #$radar (#$softwareSystemFn "scene"))

    Of course, the real fun begins when we establish P2P knowledge sharing networks over channels like encrypted IM, allowing communication. When integration is further made to our goaling system, the result is quite usable. Integrated with an augmented reality wearable computer system or even just a cell phone, the results are quite staggering. Like a stock ticker except about arbitrary concepts and events.

    However, there is also an execution component, via the cyc-mode emacs major mode, which allows the user to control interaction with CycL in the emacs environment. This is very powerful from a power user / knowledge representation point of view, because emacs is basically the world's most advanced symbolic knowledge manipulation environment. This interface allows the users to manipulate onscreen information and events using commands bound to key sequences.

    We also apply clear eyetracking to visually track which axioms the user is viewing in order to behave contingently. So for instance if the user looks at a particular item longer, it could possibly expand the context for that item.