Opened 4 years ago

Closed 4 years ago

#4854 closed enhancement (duplicate)

Allow specifying frame start, stop and step when opening DCD trajectory to limit memory use

Reported by: goddard@… Owned by: Eric Pettersen
Priority: normal Milestone:
Component: MD/Ensemble Analysis Version:
Keywords: Cc:
Blocked By: Blocking:
Notify when closed: Platform: all
Project: ChimeraX

Description

The following bug report has been submitted:
Platform:        macOS-10.15.7-x86_64-i386-64bit
ChimeraX Version: 1.3.dev202105180049 (2021-05-18 00:49:36 UTC)
Description
When opening a DCD file it would be handy to be able to specify start, stop, and step frame parameters so that the whole possibly enormous file does not need to be read into memory.  Big trajectories are common.

The case I am looking at now is a 5 Gbyte DCD file which causes ChimeraX to use 13 Gbytes of memory.

Log:
UCSF ChimeraX version: 1.3.dev202105180049 (2021-05-18)  
© 2016-2021 Regents of the University of California. All rights reserved.  
How to cite UCSF ChimeraX  

> open /Users/goddard/Downloads/6vsb_1_1_1.pdb

Chain information for 6vsb_1_1_1.pdb #1  
---  
Chain | Description  
A B C | No description available  
  

> show atoms

> select all

72990 atoms, 74307 bonds, 4407 residues, 1 model selected  

> select clear

> select ligand

14040 atoms, 14559 bonds, 588 residues, 1 model selected  

> select clear

> open /Users/goddard/Downloads/6vsb_1_1_2.pdb

Chain information for 6vsb_1_1_2.pdb #2  
---  
Chain | Description  
A B C | No description available  
  

> mmaker #2 to #1

Parameters  
---  
Chain pairing | bb  
Alignment algorithm | Needleman-Wunsch  
Similarity matrix | BLOSUM-62  
SS fraction | 0.3  
Gap open (HH/SS/other) | 18/18/6  
Gap extend | 1  
SS matrix |  |  | H | S | O  
---|---|---|---  
H | 6 | -9 | -6  
S |  | 6 | -6  
O |  |  | 4  
Iteration cutoff | 2  
  
Matchmaker 6vsb_1_1_1.pdb, chain C (#1) with 6vsb_1_1_2.pdb, chain C (#2),
sequence alignment score = 6588.2  
RMSD between 1233 pruned atom pairs is 0.176 angstroms; (across all 1273
pairs: 1.351)  
  

> hide #1 models

> show #1 models

> hide

> show ligand

> hide #2 models

> show #2 models

> hide #2 models

> show #2 models

> style ligand sphere

Changed 28080 atom styles  

> close #2

> usage open

open names [format format] [fromDatabase fromDatabase] [name a text string]
[format/database-specific arguments]  
— read and display data  
names: file names to open; a name of 'browse' will bring up a file browser  
format: one of aln, amber, amira, apbs, bild, brix, ccd, ccp4, cellpack, cmap,
cmd, collada, com, compiled python, cube, dat, dcd, defattr, delphi, dicom,
dock, dsn6, dv, emanhdf, fasta, fchk, fsc, gltf, gopenmol, gro, hdf, hssp,
html, ihm, images, imagic, imod, imodmap, ims, log, macmolplt, markers, mmcif,
mmtf, mol2, mrc, msf, mtz, netcdfmap, obj, out, pdb, pdbqt, pfam, photo, pif,
pir, positions, priism, profec, pseudobonds, python, rmf, rsf, schrodinger
maestro, sdf, segger, session, sff, situs, smiles, spider, stl, stockholm,
storm, swc, tom_em, trr, uhbd, uniprot, vtk, web fetch, xplor, xtc, or xyz  
fromDatabase: one of ccd, cellPACK, eds, edsdiff, emdb, ftp, help, http,
https, pdb, pdbdev, pdbe, pdbe_bio, pdbj, pubchem, rcsb_bio, smiles, or
uniprot  
format/database-specific arguments: format- or database-specific arguments; to
see their syntax use 'usage open format format' or 'usage open database
database' commands respectively, where format and database are as per the
above  

> usage open format dcd

open names [structureModel a structure specifier] [replace true or false]  
— read and display data  
names: file names to open; a name of 'browse' will bring up a file browser  

> close

> open /Users/goddard/Downloads/6vsb_1_1_1_traj_dcd/initial/prot_gly_memb.pdb

Summary of feedback from opening
/Users/goddard/Downloads/6vsb_1_1_1_traj_dcd/initial/prot_gly_memb.pdb  
---  
warnings | Ignored bad PDB record found on line 1  
REMARK GENERATED BY CHARMM-GUI (HTTP://WWW.CHARMM-GUI.ORG)  
  
Ignored bad PDB record found on line 2  
REMARK INPUT FILES FOR EQUILIBRATION  
  
Ignored bad PDB record found on line 3  
REMARK DATE: 8/30/20 22:40:33 CREATED BY USER: kyo  
  
Ignored bad PDB record found on line 332716  
TER 332713 DPPS 2342  
  
Chain information for prot_gly_memb.pdb #1  
---  
Chain | Description  
? | No description available  
  

> open /Users/goddard/Downloads/6vsb_1_1_1_traj_dcd/initial/prot_gly_memb.pdb

Summary of feedback from opening
/Users/goddard/Downloads/6vsb_1_1_1_traj_dcd/initial/prot_gly_memb.pdb  
---  
warnings | Ignored bad PDB record found on line 1  
REMARK GENERATED BY CHARMM-GUI (HTTP://WWW.CHARMM-GUI.ORG)  
  
Ignored bad PDB record found on line 2  
REMARK INPUT FILES FOR EQUILIBRATION  
  
Ignored bad PDB record found on line 3  
REMARK DATE: 8/30/20 22:40:33 CREATED BY USER: kyo  
  
Ignored bad PDB record found on line 332716  
TER 332713 DPPS 2342  
  
Chain information for prot_gly_memb.pdb #2  
---  
Chain | Description  
? | No description available  
  

> close #2

> open /Users/goddard/Downloads/6vsb_1_1_1_traj_dcd/trj_nos.dcd

Must specify a structure model to read the coordinates into  

> open /Users/goddard/Downloads/6vsb_1_1_1_traj_dcd/trj_nos.dcd structureModel
> #1

Replaced existing frames of prot_gly_memb.pdb #1 with 1283 new frames  

> coordset slider #1

> select all

332712 atoms, 324902 bonds, 6757 residues, 1 model selected  

> select clear

> select ligand

272003 atoms, 264355 bonds, 2938 residues, 1 model selected  

> select :POPE

52875 atoms, 50219 bonds, 423 residues, 1 model selected  

> select :POPE,PSM

112565 atoms, 107377 bonds, 893 residues, 1 model selected  

> select :POPE,PSM,POPC

131459 atoms, 125467 bonds, 1034 residues, 1 model selected  

> select :POPE,PSM,POPC,DPPE

165581 atoms, 157876 bonds, 1316 residues, 1 model selected  

> select :POPE,PSM,POPC,DPPE,POPS

183488 atoms, 174986 bonds, 1457 residues, 1 model selected  

> hide :POPE,PSM,POPC,DPPE,POPS

> hide :POPE,PSM,POPC,DPPE,POPS,DPPS

> hide :POPE,PSM,POPC,DPPE,POPS,DPPS,CHL1

> hide :POPE,PSM,POPC,DPPE,POPS,DPPS,CHL1,DPPC

> lighting soft

> lighting full

> lighting simple

> lighting soft

> select @@serial_number=10608

1 atom, 1 residue, 1 model selected  

> select up

24 atoms, 23 bonds, 1 residue, 1 model selected  

> select up

97 atoms, 97 bonds, 6 residues, 1 model selected  

> select up

332712 atoms, 324902 bonds, 6757 residues, 1 model selected  

> select clear

> hide protein

> show protein ribbons

> lighting simple

> usage namesel

"namesel" is not a command name  

> usage name

name name [text]  
— Define specifier name as a string  
name: a text string  
text: the rest of line

name delete name  
— Remove user-defined specifier name  
name: a text string

name frozen name objects  
— Define specifier name as atoms in current session matching a string  
name: a text string

name list [builtins true or false]  
— List user-defined specifier names  

> name mem :POPE,PSM,POPC,DPPE,POPS,DPPS,CHL1,DPPC

> show mem

> hide mem

> style ligand & ~mem sphere

Changed 14040 atom styles  

> show mem

> hide mem

> preset cartoons/nucleotides cylinders/stubs

Changed 59232 atom styles  
Preset expands to these ChimeraX commands:

    
    
    show nucleic
    hide protein|solvent|H
    surf hide
    style (protein|nucleic|solvent) & @@draw_mode=0 stick
    cartoon
    cartoon style modeh def arrows t arrowshelix f arrowscale 2 wid 2 thick 0.4 sides 12 div 20
    cartoon style ~(nucleic|strand) x round
    cartoon style (nucleic|strand) x rect
    cartoon style protein modeh tube rad 2 sides 24 thick 0.6
    cartoon style nucleic x round width 1.6 thick 1.6
    nucleotides stubs

  

> graphics triangles
    
    
    7286830 total triangles in 1 models and 5 drawings
    #1 prot_gly_memb.pdb 7286830
      atoms 4820022 in 7281 instances, 662 each
      ribbons 2466808
        prot_gly_memb.pdb # ribbon tethers 0
      bonds 0
    

  

> graphics quality

Quality 1, atom triangles 662, bond triangles 160, ribbon divisions 20  

> graphics quality atomTriangles 60

> graphics quality

Quality 1, atom triangles 60, bond triangles 160, ribbon divisions 20  

> usage grap qual

graphics quality [quality] [atomTriangles atomTriangles] [bondTriangles
bondTriangles] [totalAtomTriangles an integer] [totalBondTriangles an integer]
[ribbonDivisions ribbonDivisions] [ribbonSides an integer] [colorDepth an
integer]  
— Set graphics quality parameters  
quality: a number  
atomTriangles: default or an integer  
bondTriangles: default or an integer  
ribbonDivisions: default or an integer  

> graphics quality ribbonDivisions 2

> graphics triangles
    
    
    782980 total triangles in 1 models and 5 drawings
    #1 prot_gly_memb.pdb 782980
      atoms 436860 in 7281 instances, 60 each
      ribbons 346120
        prot_gly_memb.pdb # ribbon tethers 0
      bonds 0
    

  

> graphics quality ribbonSides 4

> graphics quality

Quality 1, atom triangles 60, bond triangles 160, ribbon divisions 2  

> graphics triangles
    
    
    503900 total triangles in 1 models and 5 drawings
    #1 prot_gly_memb.pdb 503900
      atoms 436860 in 7281 instances, 60 each
      ribbons 67040
        prot_gly_memb.pdb # ribbon tethers 0
      bonds 0
    

  

> graphics quality atomTriangles 12

> graphics triangles
    
    
    154412 total triangles in 1 models and 5 drawings
    #1 prot_gly_memb.pdb 154412
      atoms 87372 in 7281 instances, 12 each
      ribbons 67040
        prot_gly_memb.pdb # ribbon tethers 0
      bonds 0
    

  

> graphics quality ribbonSides 8

> graphics quality atomTriangles 24

> color protein gray

> color protein lightgray

> color C & ligand & ~mem yellow

> set bgColor white

> graphics silhouettes true

> set bgColor black

> graphics silhouettes false

> color protein #999999

> lighting simple

[Repeated 1 time(s)]




OpenGL version: 4.1 ATI-3.10.19
OpenGL renderer: AMD Radeon Pro Vega 20 OpenGL Engine
OpenGL vendor: ATI Technologies Inc.Hardware:

    Hardware Overview:

      Model Name: MacBook Pro
      Model Identifier: MacBookPro15,3
      Processor Name: 8-Core Intel Core i9
      Processor Speed: 2.4 GHz
      Number of Processors: 1
      Total Number of Cores: 8
      L2 Cache (per Core): 256 KB
      L3 Cache: 16 MB
      Hyper-Threading Technology: Enabled
      Memory: 32 GB
      Boot ROM Version: 1554.100.64.0.0 (iBridge: 18.16.14556.0.0,0)

Software:

    System Software Overview:

      System Version: macOS 10.15.7 (19H1030)
      Kernel Version: Darwin 19.6.0
      Time since boot: 42 days 22:01

Graphics/Displays:

    Intel UHD Graphics 630:

      Chipset Model: Intel UHD Graphics 630
      Type: GPU
      Bus: Built-In
      VRAM (Dynamic, Max): 1536 MB
      Vendor: Intel
      Device ID: 0x3e9b
      Revision ID: 0x0002
      Automatic Graphics Switching: Supported
      gMux Version: 5.0.0
      Metal: Supported, feature set macOS GPUFamily2 v1

    Radeon Pro Vega 20:

      Chipset Model: Radeon Pro Vega 20
      Type: GPU
      Bus: PCIe
      PCIe Lane Width: x8
      VRAM (Total): 4 GB
      Vendor: AMD (0x1002)
      Device ID: 0x69af
      Revision ID: 0x00c0
      ROM Revision: 113-D2060I-087
      VBIOS Version: 113-D20601MA0T-016
      Option ROM Version: 113-D20601MA0T-016
      EFI Driver Version: 01.01.087
      Automatic Graphics Switching: Supported
      gMux Version: 5.0.0
      Metal: Supported, feature set macOS GPUFamily2 v1
      Displays:
        Color LCD:
          Display Type: Built-In Retina LCD
          Resolution: 2880 x 1800 Retina
          Framebuffer Depth: 24-Bit Color (ARGB8888)
          Main Display: Yes
          Mirror: Off
          Online: Yes
          Automatically Adjust Brightness: No
          Connection Type: Internal

Locale: (None, 'UTF-8')
PyQt5 5.15.2, Qt 5.15.2
Installed Packages:
    alabaster: 0.7.12
    appdirs: 1.4.4
    appnope: 0.1.2
    Babel: 2.9.1
    backcall: 0.2.0
    blockdiag: 2.0.1
    certifi: 2020.12.5
    cftime: 1.4.1
    chardet: 4.0.0
    ChimeraX-AddCharge: 1.1.3
    ChimeraX-AddH: 2.1.6
    ChimeraX-AlignmentAlgorithms: 2.0
    ChimeraX-AlignmentHdrs: 3.2
    ChimeraX-AlignmentMatrices: 2.0
    ChimeraX-Alignments: 2.1
    ChimeraX-AmberInfo: 1.0
    ChimeraX-Arrays: 1.0
    ChimeraX-Atomic: 1.25.1
    ChimeraX-AtomicLibrary: 3.3
    ChimeraX-AtomSearch: 2.0
    ChimeraX-AtomSearchLibrary: 1.0
    ChimeraX-AxesPlanes: 2.0
    ChimeraX-BasicActions: 1.1
    ChimeraX-BILD: 1.0
    ChimeraX-BlastProtein: 1.1.1
    ChimeraX-BondRot: 2.0
    ChimeraX-BugReporter: 1.0
    ChimeraX-BuildStructure: 2.5.2
    ChimeraX-Bumps: 1.0
    ChimeraX-BundleBuilder: 1.1
    ChimeraX-ButtonPanel: 1.0
    ChimeraX-CageBuilder: 1.0
    ChimeraX-CellPack: 1.0
    ChimeraX-Centroids: 1.1
    ChimeraX-ChemGroup: 2.0
    ChimeraX-Clashes: 2.1
    ChimeraX-ColorActions: 1.0
    ChimeraX-ColorGlobe: 1.0
    ChimeraX-ColorKey: 1.3
    ChimeraX-CommandLine: 1.1.4
    ChimeraX-ConnectStructure: 2.0
    ChimeraX-Contacts: 1.0
    ChimeraX-Core: 1.3.dev202105180049
    ChimeraX-CoreFormats: 1.0
    ChimeraX-coulombic: 1.3
    ChimeraX-Crosslinks: 1.0
    ChimeraX-Crystal: 1.0
    ChimeraX-CrystalContacts: 1.0
    ChimeraX-DataFormats: 1.1
    ChimeraX-DeepSSETracer: 0.1
    ChimeraX-Dicom: 1.0
    ChimeraX-DistMonitor: 1.1.3
    ChimeraX-DistUI: 1.0
    ChimeraX-Dssp: 2.0
    ChimeraX-EMDB-SFF: 1.0
    ChimeraX-ExperimentalCommands: 1.0
    ChimeraX-FileHistory: 1.0
    ChimeraX-FunctionKey: 1.0
    ChimeraX-Geometry: 1.1
    ChimeraX-gltf: 1.0
    ChimeraX-Graphics: 1.1
    ChimeraX-Hbonds: 2.1
    ChimeraX-Help: 1.1
    ChimeraX-HKCage: 1.3
    ChimeraX-IHM: 1.1
    ChimeraX-ImageFormats: 1.1
    ChimeraX-IMOD: 1.0
    ChimeraX-IO: 1.0.1
    ChimeraX-ItemsInspection: 1.0
    ChimeraX-Label: 1.1
    ChimeraX-ListInfo: 1.1.1
    ChimeraX-Log: 1.1.4
    ChimeraX-LookingGlass: 1.1
    ChimeraX-Maestro: 1.8.1
    ChimeraX-Map: 1.1
    ChimeraX-MapData: 2.0
    ChimeraX-MapEraser: 1.0
    ChimeraX-MapFilter: 2.0
    ChimeraX-MapFit: 2.0
    ChimeraX-MapSeries: 2.1
    ChimeraX-Markers: 1.0
    ChimeraX-Mask: 1.0
    ChimeraX-MatchMaker: 1.2.1
    ChimeraX-MDcrds: 2.2
    ChimeraX-MedicalToolbar: 1.0.1
    ChimeraX-Meeting: 1.0
    ChimeraX-MLP: 1.1
    ChimeraX-mmCIF: 2.3
    ChimeraX-MMTF: 2.1
    ChimeraX-Modeller: 1.0.1
    ChimeraX-ModelPanel: 1.1
    ChimeraX-ModelSeries: 1.0
    ChimeraX-Mol2: 2.0
    ChimeraX-Morph: 1.0
    ChimeraX-MouseModes: 1.1
    ChimeraX-Movie: 1.0
    ChimeraX-Neuron: 1.0
    ChimeraX-Nucleotides: 2.0.1
    ChimeraX-OpenCommand: 1.5
    ChimeraX-PDB: 2.4.1
    ChimeraX-PDBBio: 1.0
    ChimeraX-PDBLibrary: 1.0.1
    ChimeraX-PDBMatrices: 1.0
    ChimeraX-PickBlobs: 1.0
    ChimeraX-Positions: 1.0
    ChimeraX-PresetMgr: 1.0.1
    ChimeraX-PubChem: 2.0.1
    ChimeraX-ReadPbonds: 1.0
    ChimeraX-Registration: 1.1
    ChimeraX-RemoteControl: 1.0
    ChimeraX-ResidueFit: 1.0
    ChimeraX-RestServer: 1.1
    ChimeraX-RNALayout: 1.0
    ChimeraX-RotamerLibMgr: 2.0
    ChimeraX-RotamerLibsDunbrack: 2.0
    ChimeraX-RotamerLibsDynameomics: 2.0
    ChimeraX-RotamerLibsRichardson: 2.0
    ChimeraX-SaveCommand: 1.4
    ChimeraX-SchemeMgr: 1.0
    ChimeraX-SDF: 2.0
    ChimeraX-Segger: 1.0
    ChimeraX-Segment: 1.0
    ChimeraX-SelInspector: 1.0
    ChimeraX-SeqView: 2.4
    ChimeraX-Shape: 1.0.1
    ChimeraX-Shell: 1.0
    ChimeraX-Shortcuts: 1.1
    ChimeraX-ShowAttr: 1.0
    ChimeraX-ShowSequences: 1.0
    ChimeraX-SideView: 1.0
    ChimeraX-Smiles: 2.0.1
    ChimeraX-SmoothLines: 1.0
    ChimeraX-SpaceNavigator: 1.0
    ChimeraX-StdCommands: 1.6
    ChimeraX-STL: 1.0
    ChimeraX-Storm: 1.0
    ChimeraX-Struts: 1.0
    ChimeraX-Surface: 1.0
    ChimeraX-SwapAA: 2.0
    ChimeraX-SwapRes: 2.1
    ChimeraX-TapeMeasure: 1.0
    ChimeraX-Test: 1.0
    ChimeraX-Toolbar: 1.1
    ChimeraX-ToolshedUtils: 1.2
    ChimeraX-Tug: 1.0
    ChimeraX-UI: 1.10
    ChimeraX-uniprot: 2.1
    ChimeraX-UnitCell: 1.0
    ChimeraX-ViewDockX: 1.0
    ChimeraX-Vive: 1.1
    ChimeraX-VolumeMenu: 1.0
    ChimeraX-VTK: 1.0
    ChimeraX-WavefrontOBJ: 1.0
    ChimeraX-WebCam: 1.0
    ChimeraX-WebServices: 1.0
    ChimeraX-Zone: 1.0
    colorama: 0.4.4
    comtypes: 1.1.10
    cxservices: 1.0
    cycler: 0.10.0
    Cython: 0.29.23
    decorator: 4.4.2
    distlib: 0.3.1
    docutils: 0.17.1
    filelock: 3.0.12
    funcparserlib: 0.3.6
    grako: 3.16.5
    h5py: 3.2.1
    html2text: 2020.1.16
    idna: 2.10
    ihm: 0.20
    imagecodecs: 2021.4.28
    imagesize: 1.2.0
    importlib-metadata: 4.0.1
    ipykernel: 5.5.5
    ipython: 7.23.1
    ipython-genutils: 0.2.0
    jedi: 0.18.0
    Jinja2: 2.11.3
    jupyter-client: 6.1.12
    jupyter-core: 4.7.1
    kiwisolver: 1.3.1
    lxml: 4.6.3
    lz4: 3.1.3
    MarkupSafe: 1.1.1
    matplotlib: 3.4.2
    matplotlib-inline: 0.1.2
    msgpack: 1.0.2
    netCDF4: 1.5.6
    networkx: 2.5.1
    numpy: 1.20.3
    numpydoc: 1.1.0
    openvr: 1.16.801
    packaging: 20.9
    pandas: 1.2.4
    ParmEd: 3.2.0
    parso: 0.8.2
    pexpect: 4.8.0
    pickleshare: 0.7.5
    Pillow: 8.2.0
    pip: 21.1.1
    pkginfo: 1.7.0
    prompt-toolkit: 3.0.18
    psutil: 5.8.0
    ptyprocess: 0.7.0
    pycollada: 0.7.1
    pydicom: 2.1.2
    Pygments: 2.9.0
    PyOpenGL: 3.1.5
    PyOpenGL-accelerate: 3.1.5
    pyparsing: 2.4.7
    PyQt5: 5.15.2
    PyQt5-sip: 12.8.1
    PyQtWebEngine: 5.15.2
    python-dateutil: 2.8.1
    pytz: 2021.1
    pyzmq: 22.0.3
    qtconsole: 5.1.0
    QtPy: 1.9.0
    RandomWords: 0.3.0
    requests: 2.25.1
    scipy: 1.6.3
    setuptools: 56.2.0
    sfftk-rw: 0.7.0.post1
    six: 1.16.0
    snowballstemmer: 2.1.0
    sortedcontainers: 2.3.0
    Sphinx: 4.0.1
    sphinxcontrib-applehelp: 1.0.2
    sphinxcontrib-blockdiag: 2.0.0
    sphinxcontrib-devhelp: 1.0.2
    sphinxcontrib-htmlhelp: 1.0.3
    sphinxcontrib-jsmath: 1.0.1
    sphinxcontrib-qthelp: 1.0.3
    sphinxcontrib-serializinghtml: 1.1.4
    suds-jurko: 0.6
    tifffile: 2021.4.8
    tinyarray: 1.2.3
    torch: 1.8.1
    tornado: 6.1
    traitlets: 5.0.5
    typing-extensions: 3.10.0.0
    urllib3: 1.26.4
    wcwidth: 0.2.5
    webcolors: 1.11.1
    wheel: 0.36.2
    wheel-filename: 1.3.0
    zipp: 3.4.1

Change History (3)

comment:1 by Tom Goddard, 4 years ago

Component: UnassignedMD/Ensemble Analysis
Owner: set to Eric Pettersen
Platform: all
Project: ChimeraX
Status: newassigned
Summary: ChimeraX bug report submissionAllow specifying frame start, stop and step when opening DCD trajectory to limit memory use
Type: defectenhancement

comment:2 by Eric Pettersen, 4 years ago

Status: assignedaccepted

comment:3 by Eric Pettersen, 4 years ago

Resolution: duplicate
Status: acceptedclosed

Duplicate of #4501

Note: See TracTickets for help on using tickets.