Realtime Online Data Analysis in WOOOMM

Robert Burgholzer — Fri, 30 Apr 2010 19:13:18 -0000

New version of WOOOMM has been released on the testing site, with the beginning of a new family of functions being featured ( http://deq1.bse.vt.edu/wooomm/ ). This family of functions offers "Realtime Online Data Analysis", basically allowing you to perform queries on the fly on recently run models without having to download the data onto your system and import it into excel or access. This allows you to do ad-hoc queries, for example, if you use QueryWizard components to generate model reports, you can make tweaks to these queries and try them out online without re-running the model. So, for example, say you want to know the monthly minimum flow for some period of time during your most recent run, and you want it quickly. Just go to your channel object, hit the "Data Analysis" panel, and select a query with month, and flow and select the function "min" for the flow column, and hit "execute" button. The query will spit you’re the results from the most recent model run back to you in seconds.

The basic query interface appears in the new tab "Data Analysis", and allows you to load the model data into a database table, and to do custom SQL-wizard based queries on the data. Since these data sets are fairly large, it does not load them by default, you have to tell it to (follow the instructions in the "Data Analysis" tab if a table of data does not appear for you). Also, you will have had to run the model in the last 2 days, since this new family of functions uses some new data files that are produced in the post-processing phase of a model run (once again, the "Data Analysis" tab will tell you if you need to do this).

Future functionality planned:
- export any queried data as an excel file
- ability to run sub-component graphing routines, and query routines on the datasets produced by your custom queries
- ability to use a 1-click means of converting queries from the "Data Analysis" tab into querywizard sub-components to be executed the next time you run your model.
- ability to page through different model run data sets and compare query results from multiple runs (will come when the "save model scenario data" functions are completed)

Regards,
r.b.

Robert W. Burgholzer
Surface Water Modeler
Office of Water Supply and Planning
Virginia Department of Environmental Quality
rwburgholzer@deq.virginia.gov

Web Hydro Objects Version 0.8 released

Robert Burgholzer — Wed, 02 Jan 2008 21:14:12 -0000

Version 0.8 is a major release of the Web Hydrology Objects, containing a number of feature enhancements, as well as a pre-configured example data set.

Major Features:
- Robust model component linking allows you to connect outputs and properties of one modeling object to another, similar in behavior to those in dynamic systems modeling environments such as Stella and PowerSim.
- a fully functional web interface for storing and editing model components and scenarios
- user authentication modules and scenario storage and access control
- integration of libraries for pulling USGS data, NOAA data and HSPF UCI files into modeling components
- User-defined equation editor on modeling objects
- BASH installation script to create underlying databases, and load sample data

Habitat Suitability Index Demonstration of Equation Feat

Robert Burgholzer — Wed, 01 Aug 2007 14:59:51 -0000

A library to allow dynamic evaluation of simple mathematical equations has been added to the hydro objects library. Also added are the functionality of lookup tables in the modelObject (both exact match and interpolated lookup tables). The file demo_hsi.php shows this capability by creating a Habitat Suitability Index calclulation for smallmouth bass, based on the work of the United States Fish and Wildlife Server (USWFS). This demo uses both types of lookup tables, relationships between hydro objects, and user defined equations to compute the habitat suitability index. An online demo of this routine can be found at:
http://soulswimmer.dynalias.net/models/wsdemo/demo_hsi.php

Web Hydro Objects version 0.1 released

Robert Burgholzer — Fri, 20 Jul 2007 17:21:40 -0000

I have uploaded a new set of files onto the NPSource project download area (http://sourceforge.net/projects/npsource/ - the package name is "Web-Hydro Objects") which contain a new web-enabled hydrologic modeling library written in PHP. The libraries contain object-oriented web hydro modeling capabilities, as well as routines to automatically retrieve USGS monitoring data.

A simple demo which models the effects of water withdrawals from a stream can be run from my server at:
http://soulswimmer.dynalias.net/models/wsdemo/demo.php

This demo simulates a system with a reach that has its flow inputs defined by a USGS gage output, and has two withdrawals, one of which goes into a modeled reservoir with a daily yield demand of 72 CFS. The user can select a USGS gage to act as the upstream inflow of the modeled reach, the reach length and base width (the demo assumes side slope Z = 1.0), and area factor to scale flow input, a time step, a simulation start/end date, and the triggers for the stream water withdrawals. After entering the input data, clicking on "Show Time Series" will run the simulation. The routine will go out to the USGS NWIS system and retrieve the upstream flow input for the desired time period, then run the simulation, executing water withdrawals from the simulated reach according to the rules entered. The output will be displayed in a general hydrograph form with pre and post-withdrawal flows, and pre and post-withdrawal flow-duration curves. There will also be downloadable CSV files of the flow output.

The default inputs in this demo will model a scenario with two realistic withdrawals from the James River near Richmond Virginia. Users may also choose any NWIS accessible USGS station for upstream flow input to the modeled reach. You may base water withdrawals on the reach Inflow (Qin), outflow (Qout), or the depth of flow. Be kind using the demo on soulswimmer.dynalis.net, as this server is beyond rickety (a P133 Mhz), a 5 year simulation takes about 5 minutes, and something longer than about 10 years will consume too much memory and crash the routine. When installed on a modern machine the demo will run 5 years in less than 30 seconds, with a majority of that time spent retrieving the USGS data.

Installation instructions are in the file README.txt that is in the file web_hydro_objects_0.1.tar.gz downloadable from the Source Forge site (listed above). This library has been run successfully on both Linux and Windows systems (both running apache web server).

Please feel free to contact me on this listserv, or at rburghol@vt.edu with any requests, comments, or suggestions.

Rob

Below is installation description for web hydro objects libraries and demo.

README.txt
Description:
The PHP library lib_hydrology.php contains a prototype set of Object Oriented routines for constructing a hydrologic model that can be run via a web interface. The objects contained in this library include: a surface infiltration and runoff object, a trapezoidal channel storage routing object, a rule-based water withdrawal object (which interacts with the channel storage routing object)

Requirements:
- >= PHP 5.1
- >= jpgraph 2.2 - Necessary only for the graphical output when running the demo "demo.php", technically, the hydrology objects do NOT require jpgraph.

Installation:
- unpack hydro_demo.tar.gz into your web server folder
- Set the variables: "$basedir" - base folder for install, "$libdir" - location of where you installed the accompanying library files, and "$glibdir" - location of jpgraph libraries, only needed if you use the graphing in the demo.php file.
- Make sure that the sub-directory "out" is writeable by the web-server process. The graphs and csv output files will be stored there.
- Run the routine by accessing "demo.php" on your site in a browser. Use default data, or enter your own USGS gage, stream reach dimensions, and withdrawal rules.

File Manifest:
- test4.php - beta version of a flow routing and reservoir withdrawal rule algorithms in lib_hydrology.php
- config.php - configuration information. You must set the proper path in the variable "$basedir" for your installation.

Component libraries:
lib_hydrology.php - contains functions recently ported into php from a C library that I have been developing to perform routine hydrology calculations, such as green-ampt infiltration rates, soil properties estimates from sand/clay fractions, and storage routing in trapezoidal channels. lib_usgs.php - library for retrieving data from the USGS gage network. Can retrieve both real-time and historical data for stream gages, lakes, and groundwater wells. db_functions.php - a menagerie of functions misc_functions.php - another menagerie
file_functions.php - functions for reading and writing to files lib_plot.php - some basic graphing functions

Recent posts to news

Realtime Online Data Analysis in WOOOMM

Web Hydro Objects Version 0.8 released

Habitat Suitability Index Demonstration of Equation Feat

Web Hydro Objects version 0.1 released