The scheenshot on the right is of a webapp I developed to help track the movement of nurses in a hospital. The webapp is to be used by someone tracking a nurse and is optimized for iPads. The user taps on each event as it happens and the app records the time and duration of all events.
The app uses jquery mobile and localStorage so all the data is stored on the iPad, since there is no wifi on the hospital floor (that we can use). At the end of the day the user can then upload all the data to the server by the click of a button.
We then use this data to feed our 2D Netlogo models, and 3D Unity models, which you can learn more about by reading some of our recent papers.
This work is part of research we are doing with the School of Nursing into building agent-based models of workflows inside a hospital, and how these might be used to help reduce errors, and optimize flow.
Putting the magic in the machine since 1980.
Wednesday, November 6, 2013
Android and Speech Recognition Hacking
As part of this project, I developed an Android app that uses the built-in voice recognition to let nurses check items for a patient as he is getting ready for surgery.
Voice recognition is was found to be not good enough, for some words. We are examining possible ways of post-processing the results that come back from Google in order to improve the accuracy, for our domain. For this, I am starting with simple Bayesian learning techniques, but, we might try other techniques in the near future.
The app you see on the right was just for testing. I have another app which implements the actual checklists. We plan to tie it to the hospital's Electronic Medical Records systems using their REST API. Fun stuff!
As always, if you are a USC student (grad or undergrad) interested in hacking on think kind of stuff, just email me. We are also building 3D simulations in Unity.
Voice recognition is was found to be not good enough, for some words. We are examining possible ways of post-processing the results that come back from Google in order to improve the accuracy, for our domain. For this, I am starting with simple Bayesian learning techniques, but, we might try other techniques in the near future.
The app you see on the right was just for testing. I have another app which implements the actual checklists. We plan to tie it to the hospital's Electronic Medical Records systems using their REST API. Fun stuff!
As always, if you are a USC student (grad or undergrad) interested in hacking on think kind of stuff, just email me. We are also building 3D simulations in Unity.
Labels:
programming,
research
Senior Capstone Project with GitHub
This year I am teaching our Senior Capstone Project class.
I am using git and github to keep all the 14 different projects on the same page, more or less, or at least, to keep me from completely losing control. The github wiki pages come in handy for keeping all the other project-related documents: Design, Architecture, and Requirements documents.
To learn more, check out my git and github videos and presentations.
I am using git and github to keep all the 14 different projects on the same page, more or less, or at least, to keep me from completely losing control. The github wiki pages come in handy for keeping all the other project-related documents: Design, Architecture, and Requirements documents.
To learn more, check out my git and github videos and presentations.
Labels:
teaching
Subscribe to:
Posts (Atom)