USGS Data Management

blank space
Plan > Organize Files and Data
U.S. Geological Survey Data Lifecycle Diagram Plan Acquire Process Analyze Preserve Publish/Share Manage Quality Describe (Metadata, Documentation) Backup & Secure The USGS Science Data Lifecycle
U.S. Geological Survey Data Lifecycle Diagram

Organize Files and Data

File organization with a logical, clear structure and labeling system enables not only others to access your data, but makes it easier for you to find your own data as well. These are the public's data, and we have a stewardship responsibility to the data. Thinking about how you will organize your files and data early on in planning may save you from having to reorganize and rename files later on.

Best Practices

Example: Why File Organization Matters

A wildlife biologist for a small field office was the in-house GIS expert and provided support for all the staff's GIS needs. However, the data were stored on her own workstation. When the biologist relocated to another office, no one understood how the data were stored or managed.

  • Solution: A state office GIS specialist retrieved the workstation and sifted through files trying to salvage relevant data.
  • Cost: One work-month ($4,000) plus the value of data that were not recovered.

  • Document your organizational structure and if it makes sense, use it as a basis for organizing your files; otherwise, use a logical naming convention for files and folders.
    • Example:
      • Proposals > 2011
      • Proposals > 2012
  • Use consistent file names and formats within a project.
    • If using abbreviations in file or folder names, ensure that others are using the same abbreviations.
      • Consider including a "readme" file along with the dataset that spells out any abbreviations or acronyms.
    • Make sure that names are unambiguous and describe the contents satisfactorily.
    • If including dates in the filenames, use a consistent format, such as YYYYDDMM.
    • Consider using underscores "_" or dashes "-" instead of spaces in file names, as not all computer systems accept spaces.
    • Use consistent names from project to project.
      • Example: if a folder is named "photos" in one directory, don't use "images" elsewhere for a file of photographs.
  • Use version control.
    • Example: "red_moth_analysis_v1.doc" or "red_moth_analysis_FINAL.doc"
  • Use a consistent naming convention for long-term data preservation. [see Preserve > Archiving and Preserve > Disposition]
    • Organize based on the next step or status (e.g., Draft, Disposition).
  • When backing up your data, use an automated backup software which will mirror and preserve file structures. [see Back Up & Secure]
  • Use colors to group folders together visually.

What the U.S. Geological Survey Manual Requires:

The USGS Manual Handbook for Managing Records, 432-1-H, October 1990 covers both physical and electronic files:

"This Survey Manual Handbook (432-l-H) supplements the USGS Files Management Program objectives set forth in SM 432.l (Records Management Program) and SM 431.9 (Micrographics) Specifically, it prescribes standards and procedures to ensure that adequate and proper records are made and preserved to fully document the organization, functions, policies, decisions, procedures and essential transactions of the U.S. Geological Survey; and to furnish the information necessary to protect the legal and financial rights of the USGS and persons directly affected by its activities."

Recommended Reading