Version 13 (modified by 6 years ago) ( diff ) | ,
---|
SOW Deliverables
End of contract: February 29, 2020
- Virtual Reality user interface development (Tom 348 hours, Elaine 87 hours, Eric 696 hours, Conrad 87 hours)
- Provide task specific user interfaces (i.e. GUI panels and/or appropriate icons) for the following areas:
- medical imaging
- cryoEM modeling -- rotamers, structure building and verification, minimization
- Measure and display distance between two specified points in space in VR, both molecular models and medical images.
- Investigate and optionally prototype control of VR sessions by speech recognition, using a controlled vocabulary and grammar. This will support better accessibility for disabled users, e.g., users with limb differences who would have trouble with some aspects of the VR hand controllers.
- Provide task specific user interfaces (i.e. GUI panels and/or appropriate icons) for the following areas:
- Extend medical imaging data visualization and analysis (Tom 348 hours, Elaine 87 hours)
- Improve native .dcm support, e.g., compatibility for segmented dicom files.
- Provide presets for different tissue types in CT scans.
- Support for multiuser sessions in a virtual reality environment (Tom 87 hours, Eric 174 hours, Conrad 435 hours)
- The application will allow multiple ChimeraX users to enter a shared session to interact with a 3D representation of the data in virtual reality
- An ideal solution will allow users from both ends (remote, or in the same physical room) to start meetings on demand and to connect without opening firewalls.
- Outreach
- Workshops, Training and presentations (Tom 164 hours, Elaine 87 hours)
- If available, the subcontractor shall attend a meeting at NIAID’s Rocky Mountain Labs location in Hamilton, Montana. This is tentatively scheduled for August 5-9, 2019, as part of a NIAID/OCICB site visit to showcase virtual reality technology for scientific data visualization to support NIAID research.
- The subcontractor may propose one or more additional conference events relevant to the work, at which they will showcase the application in an oral presentation and/or hands-on conference exhibit or training. Justification shall be provided for how this will benefit NIAID.
- A virtual help desk for users
- Instructional Material and tools documentation (Elaine 609 hours)
- Detailed instructions for all features shall be provided in a user manual.
- Written user guides and tutorials shall be available as an HTML page and/or a downloadable PDF.
- Workshops, Training and presentations (Tom 164 hours, Elaine 87 hours)
- Project planning, administration, and reporting (Tom 87 hours, Scooter 174 hours)
- A project schedule, implementation plan, and documentation plan will be provided.
- Reports will be provided for all subtasks described under each task.
Progress October 31, 2019
- Virtual Reality user interface development (Tom 348 hours, Elaine 87 hours, Eric 696 hours, Conrad 87 hours)
- Provide task specific user interfaces (i.e. GUI panels and/or appropriate icons) for the following areas:
- medical imaging
- cryoEM modeling -- rotamers, structure building and verification, minimization
- ISOLDE integration with VR - initial test for feasibility
- 'swapaa' command implemented.documentation Largely a port of Chimera code, with the principal differences being:
- New code to handle the fact that Chimera treats alternate locations as separate atoms whereas ChimeraX treats them as a single atom.
- Refactored rotamer library handling so that the libraries are provided by separate bundles and therefore new rotamer libraries could be supplied by third parties via the Toolshed.
- Rotamers tool largely implemented.documentation It is also mostly a port of Chimera code, but required porting major Chimera infrastructure, e.g.:
- "Smart" table where the rows are directly based on ChimeraX data items (in this case rotamers) and the table knows how to show columns based on data item information and makes callbacks that provide the data items as arguments.
- Configurable and embeddable H-bonds GUI so that the Rotamers tool can add an H-bonds column to the rotamers table. As a "side effect" an H-bonds tool was implemented.documentation
- Similar to the previous point, a configurable and embeddable clashes/contacts GUI needs to be ported/implemented. This will be the last major piece of the Rotamers tool. When completed, both embeddable GUIs will also be incorporated into the ViewDockX tool.
- User interface improvements: menus and popup windows in VR, every tool is its own movable and closable panel, custom Oculus controller button depiction, Oculus thumbstick modes for zoom, rotate, others…
- Measure and display distance between two specified points in space in VR, both molecular models and medical images.
- Investigate and optionally prototype control of VR sessions by speech recognition, using a controlled vocabulary and grammar. This will support better accessibility for disabled users, e.g., users with limb differences who would have trouble with some aspects of the VR hand controllers.
- Provide task specific user interfaces (i.e. GUI panels and/or appropriate icons) for the following areas:
- Extend medical imaging data visualization and analysis (Tom 348 hours, Elaine 87 hours)
- Improve native .dcm support, e.g., compatibility for segmented dicom files.
- Improved DICOM read speed to be many times faster.
- Provide presets for different tissue types in CT scans.
- Improve native .dcm support, e.g., compatibility for segmented dicom files.
- Support for multiuser sessions in a virtual reality environment (Tom 87 hours, Eric 174 hours, Conrad 435 hours)
- The application will allow multiple ChimeraX users to enter a shared session to interact with a 3D representation of the data in virtual reality (scene sharing)
- An ideal solution will allow users from both ends (remote, or in the same physical room) to start meetings on demand and to connect without opening firewalls.
- Outreach
- Workshops, Training and presentations (Tom 164 hours, Elaine 87 hours)
- If available, the subcontractor shall attend a meeting at NIAID’s Rocky Mountain Labs location in Hamilton, Montana. This is tentatively scheduled for August 5-9, 2019, as part of a NIAID/OCICB site visit to showcase virtual reality technology for scientific data visualization to support NIAID research.
- Tom G attended workshop, presented ChimeraX cryoEM training, many VR demos, several new ChimeraX VR features requested by Rocky Mt people implemented (menu support, Oculus thumbstick controls)
- The subcontractor may propose one or more additional conference events relevant to the work, at which they will showcase the application in an oral presentation and/or hands-on conference exhibit or training. Justification shall be provided for how this will benefit NIAID.
- A virtual help desk for users
- If available, the subcontractor shall attend a meeting at NIAID’s Rocky Mountain Labs location in Hamilton, Montana. This is tentatively scheduled for August 5-9, 2019, as part of a NIAID/OCICB site visit to showcase virtual reality technology for scientific data visualization to support NIAID research.
- Instructional Material and tools documentation (Elaine 609 hours)
- Detailed instructions for all features shall be provided in a user manual.
- ChimeraX User Guide at the RBVI website note to Scooter because viewdockx was used as the test for the future documentation reorganization, the links to ViewDockX tool and viewdockx command help are broken in this website copy. The downloaded User Guide shown from ChimeraX help menu does not have this issue.
- Written user guides and tutorials shall be available as an HTML page and/or a downloadable PDF.
- Detailed instructions for all features shall be provided in a user manual.
- Workshops, Training and presentations (Tom 164 hours, Elaine 87 hours)
- Project planning, administration, and reporting (Tom 87 hours, Scooter 174 hours)
- A project schedule, implementation plan, and documentation plan will be provided.
- Reports will be provided for all subtasks described under each task.
- Other related developments
- Exploratorium demonstration Exploratorium After Dark Party, October 24, 6-10 pm. ChimeraX VR will be used to show programmed cells form 3D structures. Data from Wendell Lim's lab; the cells are genetically engineered to self-organize by signaling and adhesion.
- Makers Lab demonstration ChimeraX used for a virtual reality look at molecules, cells, and tissues in the UCSF Library Makers Lab, Parnassus Campus, noon-1pm November 15.2019.
- UCSF news article highlighting ChimeraX VR and drug resistance VR Drug Discovery Makes Precision Therapy a Reality and video from article on YouTube
Note:
See TracWiki
for help on using the wiki.