Observability of Human-Automation Systems

In large, complex human-automation systems, succinct user-interfaces are key for effective human-automation interaction. However, the user-interface may be misleading if insufficient or incorrect information about the underlying system is provided to the user through the user-interface. We consider the user-interface to be an output map to a hybrid dynamical system, and pose the question of adequate information in the user-interface as one of observability. The user is a special type of observer, with additional constraints that model human limitations of information processing, as well as guidelines for “good” human-automation interaction. We are interested in creating theory and computational tools for both analysis as well as design. Our current work has focused on visual modalities, but we also plan to consider auditory and haptic information streams, as well.

Related lab publications

T. Hammond, N. Eskandari, and M. Oishi, “Observability of user-interfaces for hybrid LTI systems under collaborative control: Application to aircraft flight management systems,” IEEE Transactions on Automation Science and Engineering, vol. 13, no. 1, January 2016, p. 78-84.

M. Oishi, C. Tomlin, and D. Tilbury, “Special section on human-centered automation,” IEEE Transactions on Automation Science and Engineering, Guest editorial, vol. 13, no. 1, January 2016, p. 4-6.

Related lab conference proceedings

T. Adamson, M. Oishi, H.-T. L. Chiang, and L. Tapia, “Busy beeway: A game for testing human-automation collaboration for navigation,” in Proceedings of the Tenth International Conference on Motion in Games, ser. MIG ’17. New York, NY: ACM, 2017, pp. 9:1–9:6. [Online]. Available: http://doi.acm.org/10.1145/3136457.3136471

A.P. Vinod, Y. Tang, M. Oishi, K. Sycara, C. Lebiere, and M. Lewis, “Validation of cognitive models for collaborative hybrid systems with discrete human input,” In the Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, Daejon, Korea, October 2016, p. 3339-3346.

A. P. Vinod, T. Summers, and M. Oishi, “User-interface design for MIMO LTI human-automation systems through sensor placement,” In the Proceedings of American Control Conference, Boston, MA, July 2016, pp. 5276-5283.

R. Meyer, F. Just, R. DeCarlo, M. Zefran, and M. Oishi, “Notch filter and MPC for powered wheelchair operation under Parkinson’s tremor,” In the Proceedings of American Control Conference, Portland, OR, June 2014, p. 4114-4120.

M. Oishi, “Assessing information availability for user-interfaces of shared control systems under reference tracking,” In the Proceedings of American Control Conference, Portland, OR, June 2014, p. 3474-3481.

N. Eskandari and M. Oishi, “Computing observable and predictable subspaces to evaluate user-interfaces of LTI systems under shared control,” In the Proceedings of the IEEE Int’l Conference on Systems, Man, and Cybernetics, Anchorage, AK, October 2011, p. 2803-2808. Best Student Paper Award.

M. Oishi, P. TaghipourBibalan, A. Cheng, and I.M. Mitchell, “Modeling and control of a powered wheelchair: Wall-following around a corner with infrared,” In the Proceedings of the Canadian Congress on Applied Mechanics, Vancouver, BC, June 2011, p. 25-28.

M. Oishi, A. Cheng, P. TaghipourBibalan, and I.M. Mitchell, “Building a smart wheelchair on a flexible platform,” In the Proceedings of the Rehabilitation Engineering and Assistive Technology Society (RESNA) / Festival of Int’l Conferences on Technology and Aging (FICCDAT), Toronto, ON, June 2011.

N. Matni and M. Oishi, “Reachability analysis for continuous systems under shared control: Application to user-interface design,” In the Proceedings of the IEEE Conference on Decision and Control, Shanghai, China, December 2009, p 5929-5934. Interactive paper prize.

M. Oishi and N. Matni, “Towards provably safe control of smart wheelchairs,” In the Proceedings of the AAAI Symposium, AI in Eldercare, Washington, DC, November 2008, pp. FS–08–02: 67–69.

N. Matni and M. Oishi, “Reachability-based abstraction for an aircraft landing under shared control,” In the Proceedings of the American Control Conference, Seattle, WA, June 2008.

Related books and book chapters

Design and use of assistive technology: Social, technical, ethical, and economic challenges, edited by M. Oishi, M. Van der Loos, I. Mitchell. Springer, New York, NY, November 2010.

R. A. Cortez, D. Tolic, I. Palunko, N. Eskandari, R. Fierro, M. Oishi and J. Wood, “Framework for user-guided search and adaptive tracking of maneuvering targets via cooperative UAVs,” In Advances in Intelligent and Autonomous Aerospace Systems, in the Progress in Aeronautics and Astronautics Series, edited by J. Valasek. American Institute of Aeronautics and Astronautics, Reston, VA, October 2012, p. 445-468.