Fix the bl_scrunch utility

The bl_scrunch utility was failing to update the output file header nchans field (number of fine channel frequencies). This field is now calculated based on the -f parameter.

Also, removed the obsolete match_fils.py and all references to it.

Enhance dsamp to write SIGPROC (.fil) output as well as .h5

Merge pull request #273 from texadactyl/master

Support output to either .fil or .h5 files in dsamp

Bug fix to release 2.1.1

Release 2.1.1 had missing fields in the constructed Waterfall "container".
This resulted in issue #270.

Expanded Waterfall Capability

In this past, blimpy's Waterfall class was only entertaining input from a Filterbank file (.h5 or .fil). With this release, a data array + a header dictionary may be passed instead of a file path. Note that these 2 input methodologies are mutually exclusive.

Introduce Filterbank file downsampling capability (dsamp)

The operator will supply an input path, output path, and a group_size used for the purpose of summing. For every every group_size time samples of the input data, the utility will sum the data element values into one total based on the polarisation index and fine-requency channel index. This summing is performed for each polarisation index and each channel index within a given polarisation.

E.g. if the group size = 3, then for polarisation index 1 (relative to 0) and channel index 42 (relative to 0), the sum for time samples 21 through 23 (relative to 0) for single element outdata[7, 1, 42] is given by:
indata[21, 1, 42] + indata[22, 1, 42] + indata[23, 1, 42]

The number of output samples = input array time dimension integer-divided by group_size. If the remainder of that division > 0, then the excess samples from the input array are dropped.

E.g. if the group size = 3 and the input data has 62 time samples, then the last 2 input samples are discarded.

The summing group size must be >= 2 and < input data time dimension.

Note that the tsamp header field in the output is set = the group size multiplied by the input tsamp value.

Fix misspelling of kurtosis in watutil.py

See issue #266.

Cleanup Waterfall, blimpy plotting, and regression tests

The Waterfall object ccurrently can only support the input of a Filterbank file. Therefore, it now diagnoses the following as an error:

• Missing input Filterbank path.
• Presence of a data_array.
• Presence of a header dict object (metadata).

If, in the future, issue #264 is resolved in terms of requirements, then the following might be the metadata/data input options:

• Input Filterbank path for a file containing both metadata and a data array.
• A metadata dict object + a data array matrix, both RAM-resident.

Fixed blimpy to show plots when the display supports it.

Fixed blimpy to show plots when the display supports it. See issue #263.

Help turbo_seti plot_event.py performance

In hdf_reader.py examine_h5 function, the amount of data matrix loaded was reduced.

v2.0.37 Enhanced h5diag utility

Sample output:

VERSION attribute: 2.0
header: {'DIMENSION_LABELS': array([b'time', b'feed_id', b'frequency'], dtype=object), 'az_start': 0.0, 'data_type': 1, 'fch1': 6688.96484375, 'foff': -0.00286102294921875, 'ibeam': -1, 'machine_id': 20, 'nbeams': 1, 'nbits': 32, 'nchans': 65536, 'nfpc': 1024, 'nifs': 1, 'rawdatafile': 'blc17_guppi_57991_49318_DIAG_PSR_J0332+5434_0008.0000.raw', 'source_name': 'DIAG_PSR_J0332+5434', 'src_dej': <Angle 54.5788 deg>, 'src_raj': <Angle 3.54977333 hourangle>, 'telescope_id': 6, 'tsamp': 1.073741823999999, 'tstart': 57991.570810185185, 'za_start': 0.0}
data shape: (56, 1, 65536)
Number of fine channels: 65536
NFPC: 1024
Number of coarse channels: 64
Rawspec version: 3.1.1
Librawspec version: 3.1.1
cuFFT version: 10.2.1.245
HDF5 library version: 1.8.16
Bitshuffle: ENABLED

No errors detected