NAME

saextrct -- creates a light curve and/or spectrum from XTE Science Array (SA) data.


USAGE

saextrct infile lcbinarray gtiarray maxmiss gtiorfile gtiandfile gticols outroot extenpha extenlc phasefile accumulate timecol columns multiple binsz mfracexp tnull timezero printmode lcmode spmode mlcinten mspinten writesum writemean timemin timemax timeint chmin chmax chint chbin ephem period phaseint obsdate obstime sensecase chkit clobber negative dryrun bailout mode


DESCRIPTION

saextrct creates a light curve and/or spectrum from XTE Science Array (SA) data. This task supports SA observation data from the XTE PCA and HEXTE instruments, as well as ASCA GIS Multi-channel Pulse Count (MPC) mode data and time-ordered data from the Einstein SSS.

This task creates a single light curve and/or a spectrum from one or more Science Array files, allowing options for filtering by time using FITS and/or ASCII Good Time Interval (GTI) information, by detector and layer (where available), by channel, and by phase. It takes as its input a standard Level 0 XTE/SA FITS file, or list of such files, and creates as output standard Level 2 spectral and/or light curve files in OGIP standard formats.

Internally, the task bins a requested portion of a vector column. Selection is based on (optional) GTI files or other applied filters. The binning can be specified for the entire file, or for a subset of rows that fulfil the filtering criteria.

The binning has five modes. If the bin mode ('lcmode' or 'spmode') = 'SUM' or 'EVENT_SUM', the output is the total counts -- this is the appropriate default for energy spectra. If the bin mode = 'RATE' or 'EVENT_RATE', the output is the total of the value of the counts divided by the time binsize -- this is the appropriate default for light curves. If the bin mode = 'MEAN' then the output is the mean value of the binned quantity during each time interval -- for housekeeping information or other telemetry values, this would be an appropriate default.

The time bin size ('BINSZ') and the time ranges can be entered, or will be calculated by the program if the value is set to INDEF. If the bin size is set to INDEF, 100 equally spaced bins will be produced. Note that if the BINSZ selected is less than the minimum time resolution of the first file, the BINSZ will be reset to that minimum time resolution. If subsequent files have a minimum time resolution greater than BINSZ, they will not be included in the data extraction.


PARAMETERS

infile [string - file name or @filename]
Supply either the name of the input FITS file(s) (and optional extension number in square brackets) to be binned, or an ASCII file containing several input FITS filenames to be acted upon, with one filename per line. If the latter, the ASCII filename should be preceded with an '@' symbol, e.g. '@file_of_infiles'. A maximum of 999 separate files or extensions may be supplied.

(lcbinarray = INDEF) [integer]
This value defines the working array size that is used to accumulate light bin information in the extractor. This value must be greater than 10000 (ten thousand), and defaults to 400000 (four hundred thousand). It must also be evenly divisible by 40, for technical reasons. A larger value for LCBINARRAY will lead to a larger memory requirement to run the extractor, thus it is possible to run out of system resources if this value is set too high.

In general this parameter should be left at its default value. However, it is supplied to allow the expert user to tune the extractor based upon their individual requirements. The larger the size of the light bin array, the fewer cycles are necessary to process large files. However, there may be a runtime cost if your system lacks the RAM for the size of array you have defined. Leave this value alone unless you have the requisite computing knowledge.

(gtiarray = INDEF) [integer]
This value defines the array size that is used to process and sort your GTI list. The INDEF default of 12800 is sufficient for almost all purposes. A user processing a very large number of GTIs may need to increase this value, with a resulting commensurate increase in the program size.

(maxmiss = INDEF) [integer]
In cases where the user is processing a number of lightcurve bins in excess of 100,000 (or lcbinarray), the data are processed in several cycles. If MAXMISS=INDEF (the default), all data in all files are read for each cycle. If MAXMISS is set to a discrete value, then the code will only read MAXMISS number of timestamps that fall later than the cycling time-range before skipping the rest of the data and going on to the next cycle. Thus MAXMISS is the "maximum number of misses" to tolerate before skipping to the next cycle, and the code will resume processing the data at the point where the data first fell beyond the specified cycle time-range.

If used correctly this parameter can speed up processing considerably; e.g. for XTE PCA data, MAXMISS=200 is an effective choice. However, use of this parameter assumes that (i) your data is time-ordered in ascending order and (ii) no input files have overlapping time ranges. XTE data generally fulfil these requirements.

gtiorfile = "-" [string - file name, @filename, APPLY or APPLYnnn]
The name and extension (specified with a +extnum appended to the filename, i.e., FITSFILE+2) of the input Good Time Interval (GTI) information for each file. Typically this will be the information about what time intervals within each file are acceptable as being "good" data for that particular file. A blank or "-" input indicates that no GTI checking for each individual file is required. The GTI are assumed to be in ascending time order. If this parameter is set to APPLY - the default - then the GTI information accompanying the Level 0 files in their 2nd extension will be used.

If more than one file is supplied, the files will be OR'ed together but are specific for each input file.

If this parameter is set to APPLY - the default - then the GTI information found in the 2nd extension is used, however, if the input files contain more than 1 GTI, and the GTI information is contained in e.g. the 3rd extension (the 2nd GTI in the file), then the user can use the APPLYnnn option. If this parameter is set to e.g. APPLY003, the code will automatically attempt to apply any GTI information found in the 3rd extension of the input files.

Note that in general only the GTI's included with each file being input should be used; hence the default value of "APPLY".

gtiandfile = "-" [string - file name or @filename]
The name and extension (specified with a +extnum appended to the filename, i.e., FITSFILE+2) of the input GTI information to be applied to ALL of the files. These files will be AND'ed with the "GTIORFILES" supplied in the previous parameter to filter out sections of data. This file applies to ALL of the input files that are processed. A blank or "-" indicates that no such additional GTI information should be applied.

Multiple GTI files can be specified at the GTIANDFILE parameter by entering their names in an ASCII file, and specifying this ASCII file in response to the prompt ("@gtiandfiles"). Multiple files will be sorted and ANDed together. Up to 999 GTIANDFILEs can be accepted. The good time intervals within each file are assumed to be in ascending time order.

If time intervals are supplied using the GTIANDFILE and also the TIMEINT parameter, they will be ANDed to arrive at a global set of time intervals to be applied to all input files, although users who mix the two approaches are warned to take care to take into account the TIMEZERO keyword. The TIMEZERO keyword in the GTIANDFILES are added to the specified START and STOP times (as well as to the TSTART and TSTOP keyword) to calculate the absolute times. Also, the time-ranges in the GTIANDFILES are expected to lie between the specified TSTART and TSTOP values. If the above seems confusing, it may be safer to use either the GTIANDFILE approach _or_ the TIMEINT approach, but avoid combining them.

(gticols = "START STOP") [string]
The names of the start and stop columns in the GTI file(s).

outroot = "sac" [string - output file root-name]
The root for the output file name. For the token default OUTROOT of 'sac', the output spectral file will be 'sac.pha' and the output light curve file 'sac.lc', unless these default extensions are over-ruled by use of the EXTENPHA and EXTENLC parameters.

(extenpha = ".pha") [string]
The suffix to be appended to OUTROOT to construct the name of the output FITS files containing the spectrum.

(extenlc = ".lc") [string]
The suffix to be appended to OUTROOT to construct the name of the output FITS files containing the light curve.

(phasefile = "-") [file name]
The name and extension of the input phase information file. A blank or "-" indicates that no phase checking is to be performed. This must be an ASCII file and be in the same format as that written by XSELECT or Xronos. Existence of this parameter is largely a historical relic; we advise the use of the specific time intervals for cases where the cycle time is similar to the observation length (e.g. binary orbital periods), and the use of the FASEBIN suite of tools for cases where the cycle time is much shorter than the observation length (e.g. pulsars).

accumulate = "ONE or MANY" [string]
This option operates in conjunction with COLUMNS and tells SAEXTRCT whether each column is to be maintained as a separate vector, or if they are all to be summed together into one output column. The options are ONE, for one output column, or MANY, for a separate vector for each. For example, for XTE PCA Standard Mode 2 data, answering ONE would produce a summed spectrum from all detectors and layers, while answering MANY would produce a spectrum for every detector/layer combination specified by the COLUMNS parameter, in OGIP Spectral File format #2.

timecol = "TIME" [string]
The name of the column in the input file containing timing information. This value is case sensitive unless the SENSECASE parameter is set to "no". The value for time is assumed to be a double precision scalar. Note that this column MUST be the one that all TIME related keywords refer to as well as TIMEZERO and the TSTART, TSTOP, and GTI's. Thus, you cannot specify an 'arbitrary' new column as the TIMECOL, since all of the above above keywords must accurately describe the time-stamps in this column.

columns = [string of column names, @filename or GOOD]
The name(s) of the column(s) in the input file(s) containing the integer vector(s) to be binned. The entire vector will be binned unless additional filtering is provided. Support extends for 40 separate input columns, 256 input channels, and an unlimited number of time elements for each column.

If columns = "GOOD" the Data Descriptor which describes each column will be parsed, and the column names that pass containing good science data will be sorted and used for the accumulation. If columns = "ERROR" or "BACKEST", the Data Descriptor which describes each column will be parsed, and the appropriate error columns or background columns will be used for the accumulation. [Note that the column names of the first files are stored, and all subsequent files will be searched for those column names only.]

Column names may be listed in an ASCII file, with one column per line, and entered using the '@filename' syntax.

(multiple = no) [boolean]
If MULTIPLE=yes, the BINSZ parameter will be interpreted as an integer multiplier of the intrinsic timing resolution of the data (e.g. to bin Binned Mode data up at precisely 4 times the intrinsic resolution of the data, users should supply "MULTIPLE=yes" and "BINSZ=4"). If MULTIPLE=no (the default behavior), BINSZ is interpreted as the desired binning of the output lightcurve, in seconds.

Use of this parameter is recommended for those cases where the required binsize is small, and to specify it precisely in seconds would require digits beyond the sixth decimal place, which the extractors' timing routines cannot support due to the intrinsic limitations of computer arithmetic. (Keep in mind that XTE timing resolutions are really an inverse power of 2; eg., Good Xenon data has a timing resolution of 2^-20 seconds.) See the BINSZ parameter discussion for further details on binning resolution.

binsz = INDEF [real]
The binsize, in SECONDS, to use in producing the light curve.

Use decimal expressions for sub-second increments, e.g. 0.004 for 4 milliseconds. If the supplied BINSZ is less than the minimum time resolution of the first file then the binsize will be reset to that time resolution. If subsequent files have larger minimum time resolutions, they will be skipped and not processed. Bin-sizes have a minimum resolution of 0.000001 seconds; anything smaller can cause problems both in accuracy and resolution due to the intrinsic limitations of computer arithmetic.

If BINSZ=INDEF (not recommended!), 100 evenly sized bins will be produced with a binsize of (TIMEMAX - TIMEMIN)/100.0.

Users needing fine timing resolution in their binning can set MULTIPLE=yes. If MULTIPLE=yes, the BINSZ parameter will be interpreted as an integer multiplier of the intrinsic timing resolution of the data (e.g. to rebin Binned Mode data up at precisely 4 times the intrinsic resolution of the data, users should supply "MULTIPLE=yes" and "BINSZ=4").

(mfracexp = INDEF) [real]
This option, active only when LCMODE=RATE, sets the minimum fractional part of a time bin that must be filled before it will be recorded in the Light Curve (all events meeting the filtering criteria will be included in the Spectrum). If MFRACEXP is set to 0.0 or INDEF then this option is disabled. The total number of bins removed from the Light Curve is printed out but not the total number of events removed from by thresholding. Example: if BINSZ = 10.0 seconds and MFRACEXP=0.25, any bin containing less than 2.5 seconds will be removed.

(tnull = real) [real]
This is the value that a bin or spectral value is set to when values are removed by filtering, such as is done via MLCINTEN and MSPINTEN, the maximum value for the light curve and spectrum respectively. The default is to set the value to 0.0. Another possibility would be to choose a negative number and filter these out in downstream processing.

(timezero = INDEF, numerical value, or FLOAT) [string]
This parameter was added in version 3.5.2, and was necessitated by the different usage of the TIMEZERO keyword in XTE data files and those processed by Xronos. For XTE, TIMEZERO (or TIMEZERI and TIMEZERF) is added not only to the TIME column but also to the TSTART and TSTOP keywords in the header, in accordance with the OGIP standards. Thus the only time that XTE and Xronos will agree is if the TIMEZERO parameter is set to 0.0d0 (or INDEF), since this will result in a TIMEZERO of 0.0d0 in the output files created. However, if high accuracy is the goal of the user this can give rise to a serious problem, since 7 or 8 significant digits will be lost to the integer part of the time-stamp, significantly reducing the overall accuracy.

To address the situation when the user wants high-accuracy and does not plan on processing any produced data files with Xronos, the user can specify a TIMEZERO value of his liking, with TSTART and TSTOP shifted by the same TIMEZERO amount. The numerical value specified in TIMEZERO is globally subtracted from all time-stamps, TSTART, and TSTOP keywords. Alternatively TIMEZERO may be set to FLOAT, which will cause the first time-stamp in the output light-curve to be 0.0d0 and TIMEZERI and TIMEZERF to contain the value of the 0.0 timestamp.

Note that negative values for timestamps and keywords can occur if care is not taken when choosing an appropriate value for TIMEZERO.

printmode = LIGHTCURVE, SPECTRUM, or BOTH [string]
Specifies the type(s) of file to be accumulated and written out after processing the input files. If PRINTMODE=BOTH (the default), both a spectrum and a light curve will be created. If PRINTMODE=LIGHTCURVE, a light curve will be created, but no spectrum. If PRINTMODE=SPECTRUM, a spectrum will be created, but no light curve.

lcmode = SUM, RATE, MEAN, EVENT_SUM, or EVENT_RATE [string]
Specifies the type of binning to do for the light-curve. SUM outputs the summed total counts per bin. RATE outputs the total counts per bin divided by the binsize. MEAN outputs the mean value of the binned quantity during each time bin. SUM and EVENT_SUM produce the same output, as do RATE and EVENT_RATE. RATE is the accepted default for light curve generation.

spmode = SUM, RATE, MEAN, EVENT_SUM, or EVENT_RATE [string]
Specifies the type of binning to do for the spectrum. SUM outputs the total counts per channel. RATE outputs the total counts per channel, divided by the total time. MEAN outputs the mean value of the counts in each channel. SUM and EVENT_SUM produce the same output, as do RATE and EVENT_RATE. SUM is the accepted default for spectrum generation.

(mlcinten = INDEF) [double precision value]
This quantity acts as a maximum value that the light-curve quantities may not exceed. Any derived count rate exceeding this value is removed from the light curve, or set to TNULL if only one column exceeds this value.

(mspinten = INDEF) [double precision value]
This quantity acts as a maximum value that the spectral counts may not exceed. Any derived count rate exceeding this value is removed from the spectrum, or set to TNULL if only one column exceeds this value.

(writesum = "-") [string]
List of column names, the contents of which will be summed and written out as a keyword in the header of the PHA spectral file. An ASCII list of column-names can be read into this parameter using the "@filename" syntax. Column-name matching must be exact.

(writemean = "-") [string]
List of column names, the contents of which will be averaged and written out as a keyword in the header of the PHA spectral file. An ASCII list of column-names can be read into this parameter using the "@filename" syntax. Column-name matching must be exact.

timemin = INDEF [double precision real]
The minimum (or start) time to use in an accumulation. This value is given in seconds and must be in ABSOLUTE TIME (MJD is not included). Thus if the first observation has a TIMEZERO = 4.150000 seconds and the TSTART = 64360000.000 and TSTOP = 64365000.000 and you want to start one second after the data begins, you would set TIMEMIN to be equal to TIMEZERO + TSTART + 1.0 = 64360005.15000. (The FTOOLS script TIMETRANS may be used to take a range of times and convert them into ABSOLUTE TIME.)

If TIMEMIN is set to INDEF, all time intervals are included in creating the selected output.

timemax = INDEF [double precision real]
The maximum (or ending) time to use in an accumulation.

See the usage notes supplied for the TIMEMIN parameter for further information. If TIMEMAX is set to INDEF, all time intervals are included in creating the selected output.

timeint = [string] [b1-b2,b3-b4,b5-b6 or @filename]
To be used to specify a set of time intervals, given in ABSOLUTE TIME, to be used in creating the light-curve. Only times which fall within these intervals will be utilized in creating the final light-curve and spectrum. The times used must be in the form XXX.nnnnnn with the decimal point explicitly given, or unexpected errors may occur. Use of TIMEINT supercedes values input for TIMEMIN and TIMEMAX when the former are more restrictive than the latter.

(The FTOOLS script TIMETRANS may be used to take ranges of times and convert them into absolute time, and create an ASCII file which can then be input into the extractor at the TIMEINT prompt using "@ascii_filename_containing_times".)

The TIMEINT file is an ASCII file containing pairs of start and stop times, one pair per line, with no dashes or other non-numerical characters.

chmin = INDEF [integer]
Minimum energy channel to include in the accumulation. If set to INDEF the minimum energy channel used is defined by the input files. Channel information supplied must be in "original" or absolute channels, prior to any on-board channel binning that may have been performed by the EDS. If, to take a simplified example, the data files contain data grouped into 10 bins, the code will search CPIX to determine in which channel bin CHMIN exists, and that ENTIRE channel bin will be included in the accumulation, along with all other bins up to and including the bin containing CHMAX. If the first two channel bins contain energy channels 0-10 and 11-50 and CHMIN is set to 40, then ALL of the second channel bin will be included.

If no CPIX information is found, a one-to-one correspondence is assumed between the bin channel and the energy detector channel, with the first channel in the file assumed to correspond to energy channel 0, and the Nth channel in the file is set to correspond to the energy channel (N-1).

chmax = INDEF [integer]
Maximum energy channel to include in analysis. If set to INDEF the maximum energy channel used is defined by the input files. See the usage notes for CHMIN for further details.

chint = "INDEF,(1-25, 45-50, 76-255), (CPIX info), or @file" [string]
Pairs of minimum-maximum channel bins to include in the accumulation. If set to INDEF, all channels are included. Channel information supplied must be in "original" channels, prior to any on-board channel binning that may have been performed. This is the parameter to use when you want to rebin existing binned data.

Use the @filename option if you have an ASCII file containing Start_Chan Stop_Chan pairs. Such files may be created by the FTOOLS script CHANTRANS.

When analyzing data from binned modes, it is recommended that the boundaries supplied using CHINT line up with the energy channel boundaries specified in the input files processed. Otherwise, unexpected results may occur due to the intrinsic channel resolution of the data processed. For example, if CHINT specifies that original energy channels 150-200 be included but the energy binning of the file (specified by CPIX) is 0-155, 156-180, 180-255 then data from _all_ channels will be included in the PHA file -- presumably not the user's intent.

chbin = "INDEF, string, or @filename" [string]
Use of this parameter is discouraged and no support in its use can be offered.

(ephem = INDEF) [real]
For phase filtering: the Ephemeris of the zero phase given in ABSOLUTE TIME. (See TIMEMIN for more information about ABSOLUTE TIME.) Starting time to begin periodic summation of results in a given period of time. INDEF sets EPHEM to TIMEMIN.

NB: The EPHEM, PERIOD and PHASEINT parameters are largely historical relics; we advise the use of the specific time intervals for cases where the cycle time is similar to the observation length (e.g. binary orbital periods), and the use of the FASEBIN suite of tools for cases where the cycle time is much shorter than the observation length (e.g. pulsars).

(period = INDEF) [real]
For phase filtering: the period to use when when performing an accumulation (in seconds). INDEF or a blank negates its usage. See notes for EPHEM.

(phaseint = "INDEF") [string]
For phase filtering: phase intervals to process as a function of the period. Given as some decimal value of the total, i.e. 0.0-0.1,0.2-5.0,0.7-1.0 will process the times that fall within these intervals multiplied by the period. See notes for EPHEM.

(obsdate = "MJDREF" or "numerical value") [string]
The keyword name containing the zero start date of the time column of the input file. The value of the keyword indate is assumed to be in terms of Modified Julian Days. A blank or '-' will defeat zero time checking for ALL of the input files. The date of the earliest observation in all of the files processed will be used as the default. The output file zero time is set equal to the input file zero time, and is written in the same keyword as the input file. Same as GTIOBS in its effect. (The default is MJDREF.)

(obstime = "TSTART TSTOP") [string]
The keywords containing the start time and stop time of the input files. A blank will defeat zero time checking for ALL of the input files. The date of the earliest observation in all of the files processed will be used as the default. The output file zero time is set equal to the input file zero time, and is written in the same keyword as the input file. (The defaults are TSTART and TSTOP.)

(sensecase = no) [boolean]
Whether the strings input to SAEXTRCT should be interpreted as case sensitive.

(chkit = yes) [boolean]
Whether to perform checks on all of the files. At the moment the keywords checked in all files to ensure compatibility of the data are TELESCOP (the observatory or mission), APPID (the application ID), and OBJECT (the source), EXTNAM (the type of data in the file - XTE/SA) and INSTRUME (PCA or HEXTE). EXTNAM and INSTRUME are compulsory, and the application will abort if these are not provided. If a match on any of the other items fails, a warning message is printed and processing continues.

(clobber = yes) [boolean]
Whether existing output files are to be overwritten.

(negative = "IGNORE") [string]
It is generally assumed that count rates will be positive or zero, and that negative count rates that are not TNULLs indicate an overflow or a file corruption. Therefore the default behavior is to ignore negative quantities in the data stream. To override this, set negative to SUM.

(dryrun = no) [boolean]
This will run SAEXTRCT so that all input files and columns are tested for compatibility for the ACCUMULATE option without actually processing any information. A report is written describing the formats of the columns and files and problems that may cause uncertain results are flagged. Before a truly complex SAEXTRCT job, setting DRYRUN = YES for an initial run-through may prove to be a good sanity check.

(bailout = no) [boolean]
The default behavior of the extractors is to deal with any conflicting or ambiguous inputs as best they can and run to completion. For example, if a GTI file is specified which contains no data, or data that doesn't apply to the file being input, it is ignored and the code will continue. Some users prefer the code to abort rather than ignore non-applicable input, and this can be achieved by setting BAILOUT to YES, which forces an abort if _any_ input is non-standard, ambiguous or nonsensical.

(mode = "ql") [string]
This option allows the PAR file to be updated with each successful completed run so that the defaults are changed (ql = Query + Learn). If tools are run with mode=h, the code will take all existing parameter values from the parameter file unless some or all are overridden on the calling line or command line. This mode is useful for scripting, but should be used with care.


NOTES:

The code has been structured such that 1 billion light curve bins can presently be accumulated. If more than that are required, changing the parameter "itcycles" from 10,000 to something higher and recompiling will increase the size. However, no current FTOOLS can cope with such a large number of light curve bins.

Dates used must all be of a consistent system. MJD is used for all dates, TIMESYS is used to determine the time system in use and is automatically converted into seconds before processing begins.

These codes were written to run on moderate memory machines and this may cause a problem with excessive I/O for large files. If this is suspected to be a problem then the parameter NARAY, presently 256*500, can be redefined to a larger size. This parameter determines the number of memory spaces reserved when processing the file. Also NF is the maximum number of channels (currently 256) and NE specifies the maximum number of TIME elements that can be contained within each channel. ICHAN contain the maximum number of time bins that are supported. Dynamic memory allocation is in effect.


MODIFICATIONS

Many small bug fixes have been made, such that one should acquire the absolute latest version before beginning processing of any large files. It is possible that a "bug" identified below does not exist in the current version.

V3.4f:
This is an EXTENSIVE REWRITE and contains many enhancements, most of which should be transparent to the user, but were necessary to increase the flexibility of the tool. The major structural improvement was to allow the user to analyze an extensive data set with a very small time resolution.

V3.5b:
Many warnings have now been changed into aborting commands since a cascade effect would happen and since the extractors can now be applied to missions other than XTE some warnings were errors for other missions.

MAXMISS added, to improve processing speed when in a "cycling" mode - i.e., the user has specified a bin-size which results in more than 100K light-bins in the light curve. See information above.

The codes have been made truly case-insensitive but they will preserve the case of the columns as they are stored within the original files.

Previous warning messages that could cause the code to fail down stream have been made into termination errors. This will make it so that after the message about the offending behavior, the code will abort without attempting to "fix" the problem.

The code now will automatically attempt to APPLY the gti information that is contained in the second extension of XTE data files. This is called by setting GTIORFILE to APPLY. The user can override this by setting GTIORFILE to "-".

Known problems in this version:

A phase-interval problem. At the moment GTI's are detected by blank regions in the output, so that when the codes generate the GTI to append to the light curve or spectrum it does so by looking for blanks in the time-line. The maximum number allowed is 12800 at the moment, but if a user uses a small bin-size and a large period and filters on multiple phase intervals it is easy to over-flow this 12800 maximum. At the moment the only thing to do is for the user to divide the (TIMEMAX - TIMEMIN / PERIOD ) * number of phase intervals and ensure that this does not exceed 12000 or so. The code will abort if it does since that will cause a boundary violation. This is being worked on so that if the user specify phase filtering a "PHASE FILE" will be output in the form that Xronos expects and the GTI will no longer include such phase filtering information.

A minimum bin-size problem. Unfortunately, since double precision values only contain 16 digits of accurate information (see the IEEE standard on accuracy) and at the moment 8 digits are used to specify the number of seconds for MET, we are only left with 8 digits for the decimal values - thus the extractors are only accurate to 1.0D-8. Unfortunately, some of the files specify the timing resolution of the satellite beyond 8 digits (although the time-stamps can only show that level of accuracy, e.g., 6.554523228973598E+07 or 65545232.28973598 so anything after the ...98 is inaccurate) can cause problem when processing the data. Thus, rounding errors can occur. To avoid this, we recommend the user does not specify a bin-size to an accuracy greater than 1.0D-8.

Version SAEXTRCT_V3.5.2
1) The total number of time-ranges that can be filtered upon has been raised from 512 to 12800. GROSSTIMEFILT may be used to divide up data into more manageable pieces - note that filtering on 12800 time-ranges for EACH data point will slow your processing considerably, so it is in your best interest to filter your data in an optimum way.

2) The output light curve has been "shifted" so that the timestamps give the leading edge of the light-bin, rather than the center of the light bin as it did in the past. This change is reflected in the change in the TIMEPIXR keyword from 0.5 to 0.0. This change was made since Xronos no longer needs to have the light-bin's timestamp given at the center of the bin. Note that Xronos cannot accurately processed raw XTE data since it does not incorporate the TIMEZERO keyword in the same way as the XTE files. (See below for more information.)

3) In version 3.5.1 the usage of TIMEZERO was made to obey the standard XTE convention, i.e., that TIMEZERO must be applied not only to the TIME column but also to TSTART and TSTOP values, as recommended by the FITS working group. This causes an incompatibility with Xronos, which adds TIMEZERO to the TIME column, but NOT to the TSTART and TSTOP keywords. Thus, a "timezero" parameter was added to SA(SE)EXTRCT which can have any value (INDEF is the default and will set TIMEZERO = 0.0d0) and will be subtracted from the actual timestamps. If "timezero" is set equal to "FLOAT" then the value of TIMEZERO will "float" to the earliest value such that the first timestamp in the light-curve will be 0.0d0, and TSTART will also be 0.0d0 (since TIMEZERO must be added to TSTART as well as the timestamp).

4) ALL GTIANDFILEs and TIMEINT values are "merged" together to form one large GTI filter.

5) All GTI files input as GTIANDFILES and GTIORFILES are now pre-filtered and compared against the TSTART and TSTOP values given in the file. It was discovered that some users were inputting GTI ranges well outside of the TSTART and TSTOP (+ TIMEZERO) time-ranges, causing unexpected problems in calculating the valid ONTIME for science event data. This was solved by pre-filtering the GTI file based upon the TSTART and TSTOP keywords given in that extension. Basically, the codes attempt to make allowance for common user errors.

6) CHINT and CHBIN can now understand channels specified in the same format as the CPIX keyword, allowing the user to "copy" the pertinent parts of the CPIX keyword and input that into the extractors. This will rebin or channel filter the original data based upon these specifications. See the appropriate parameters for more information.

Version SAEXTRCT_V3.6:
1) A problem that occurred for GTIANDFILES that contained only 1 row has been corrected, as well as now checking for the case where the user supplies a GTIANDFILE or TIMEINT file which contains NO DATA. Both of these cases would cause all of the data points in the files being processed to be filtered out.

2) Additional information is now written to the screen describing the GTI information supplied to the program. Also, the TSTART+TIMEZERO and TSTOP+TIMEZERO specified in the GTI's are now rigidly enforced - these keywords should accurately describe the information in the extension. In the past this has not necessarily been the case for some user inputs.

3) The parameter "columns" now accepts as input either "ERROR" or "BACKEST" such that it will now find those columns, name, and the "GOOD" option will automatically filter those columns out. Note that it is not possible to select both GOOD and ERROR in the same run. The user is instructed to run SAEXTRCT twice in this instance, otherwise many other problems can occur.

Version SAEXTRCT_V4.0:
1) Certain parameters which were vestigial have been removed and are no longer described in the help, others have been made hidden.

2) A problem with using TIMEMIN and TIMEMAX with GTI files which fell way outside of the TIMEMIN and TIMEMAX has been fixed.

3) Several redundant keywords, or incorrectly described ones have been removed, or fixed.

Please report problems to xtehelp@athena.gsfc.nasa.gov.


SEE ALSO

SEEXTRCT, CHANTRANS, TIMETRANS, SAPLOT, SACHIP

CATEGORY

Aug98 ftools.xte