refinematch(1)              General Commands Manual             refinematch(1)

       refinematch - Solve for a refined match between two tomograms

       refinematch  [options]  input_file  [output_file]

       Refinematch will solve for a general 3-dimensional linear transforma-
       tion to align two volumes to each other.  It performs multiple linear
       regression on the displacements between the volumes determined at a
       matrix of positions.  The displacements must be contained in a file
       with the following form:

       Number of displacements One line for each displacement consisting of
       the X, Y, and Z
          coordinates in the first volume, then the displacements in X, Y
          and Z involved in moving from the first to the second volume

       The program will automatically eliminate "outliers", patch displace-
       ments that are likely to be incorrect because they are so extreme, when
       compared to the rest of the displacements.  This elimination is conser-
       vative, but if for some reason it operates incorrectly, you can control
       the parameters of elimination or stop the elimination from occurring.
       The program will eliminate up to 10% of the patches.  If more than this
       number are bad, either get a new set of patches that do not approach so
       close to the edge of the volume, make a model in the tomogram with con-
       tours enclosing the patches to use, eliminate the bad ones from the
       file by hand, or use Findwarp to eliminate a whole row or column of
       patches. When the mean residual exceeds a value that you specify, the
       program will exit with an error.

       A model specifying which patches to include in the fit can be quite
       simple, consisting of just a single contour enclosing the region where
       patches are generally good.  This contour can be drawn in any Z plane
       of the flipped tomogram.  However, if the good region changes through
       the depth of the tomogram, you can draw contours at several Z levels.
       If you have two layers of patches, draw two contours, one near the top
       and one near the bottom of the tomogram; if you have three layers, add
       another contour in the middle, etc.  For a given patch, the program
       will find the contour at the nearest Z level and use that one to deter-
       mine whether to include the patch.

       If there is only one layer of patches in one dimension, there is insuf-
       ficient information to solve for the full transformation, so the pro-
       gram will solve for only two of the three columns of the transformation
       matrix.  This typically occurs in the Y dimension, in which case the
       second column of the matrix is fixed at 0, 1, 0.

       Refinematch uses the PIP package for input (see the manual page for
       pip) but can still take input interactively for compatibility with
       old versions of Matchorwarp.  The following options can be specified
       either as command line arguments (with the -) or one per line in a com-
       mand file or parameter file (without the -).  Options can be abbrevi-
       ated to unique letters; the currently valid abbreviations for short
       names are shown in parentheses.

       -patch (-pat) OR -PatchFile    File name
              Name of input file with positions and displacements.  If this
              option is not entered, the first non-option argument will be
              used for the input file name.

       -output (-o) OR -OutputFile    File name
              Optional output file for the refining transformation.  If this
              option is not entered, the second non-option argument (if any)
              will be used for the output file name.

       -region (-reg) OR -RegionModel      File name
              Model file with contours enclosing the patches to be included in
              the fit

       -volume (-v) OR -VolumeOrSizeXYZ    File name
              Either the name of the file or the X, Y, and Z dimensions of the
              volume being matched to.

       -residual (-res) OR -ResidualPatchOutput      File name
              Output file for positions, displacements, and residual values.
              If the patch input file has correlation coefficients, they will
              be replaced by the residuals.

       -reduced (-red) OR -ReducedVectorOutput       File name
              Output file for residual vectors from the fit, which represent
              the vectors remaining after removing the linear component of the
              vector field.  These are referred to as reduced vectors.  If the
              input patch file has correlation coefficients, they will be
              passed into this output file; otherwise the residual values will
              be placed into the file.

       -limit (-l) OR -MeanResidualLimit   Floating point
              Limiting value for the mean residual; above this value, the pro-
              gram will exit with an error.

       -extra (-e) OR -ExtraValueSelection      Two integers
              Select only patches with extra value on one side of a criterion.
              The patch vector file can have additional columns of values
              after the displacements in X, Y, and Z.  These extra columns are
              numbered from 1, and they may also have ID values on the first
              line of the file indicating their type.  To include patches
              based on values in an extra column, enter two numbers for this
              option: the ID value or the negative of the extra column number;
              and 1 to select patches above the criterion or -1 to select ones
              below it.  You must also enter one or more threshold values with
              the -select option.  (Successive entries accumulate)

       -select (-se) OR -SelectionCriteria      Multiple floats
              One or more criteria for selecting patches based on extra val-
              ues.  If multiple criteria are entered, the fitting process will
              be repeated with each selection criterion to try to satisfy the
              residual criterion.  If there are multiple values being selected
              on, this option must be entered the same number of times as the
              -extra option and it must have the same number of criteria
              entered each time.  (Successive entries accumulate)

       -maxfrac (-ma) OR -MaxFractionToDrop     Floating point
              Maximum fraction of patches to drop from the fit by outlier
              elimination.  Enter 0 to for no outlier elimination.  The
              default is 0.1.

       -minresid (-mi) OR -MinResidualToDrop    Floating point
              The minimum residual for outlier elimination; patches with
              residuals smaller than this value will be retained no matter how
              extreme they are relative to the other patches.  The default is

       -prob OR -CriterionProbabilities    Two floats
              Two probabilities controlling outlier elimination: a criterion
              probability for a patch to be evaluated as an outlier (default
              0.01), and a criterion probability for a patch to be eliminated
              regardless of the distribution of extreme values (default

       -initial (-i) OR -InitialTransformFile   File name
              File with the 3D transformation that was used to create the vol-
              ume being aligned.  This transformation will be multiplied by
              the refining transform and output in the file specified by the
              -product option.  The two options must be entered together.  A
              side-effect of using this option is that the program will report
              the shift in Y (the presumed depth dimension) needed to align
              corresponding patches in the center of the volumes.

       -product (-prod) OR -ProductTransformFile     File name
              Name of output file for the product of the transform entered
              with the -initial option and the refining transform.

       -scale (-sc) OR -ScaleShiftByFactor      Floating point
              Factor by which to scale shifts in the transform written when
              the -product option is given.  This option is needed to get a
              transformation that can be applied to an unbinned volume when
              binned volumes have been analyzed.

       -param (-par) OR -ParameterFile     Parameter file
              Read parameter entries as keyword-value pairs from a parameter

       -help (-h) OR -usage
              Print help output

              Read parameter entries from standard input.

       If the program is started with no command line arguments, it takes
       interactive input with the following entries:

       Name of file with positions and displacements

       Either the file name, or the X, Y, and Z dimensions of the volume being
          matched to.

       Name of an IMOD model file with contours enclosing the patches to
          be included in the fit, or Return to use all patches.

       Limiting value for the mean residual; above this value, the program
          will exit with an error.

       Name of output file in which to place the transformation, or Return
          for no output to a file

       Written by David Mastronarde, 1995
       12/24/98: added outlier elimination; 6/6/99: added error exit
       8/21/06: converted to PIP, made it handle both orientations of volume
                better, changed outlier output to be a summary as in Findwarp,
                added options for controlling outlier elimination and getting
                residual output.

       Email bug reports to mast at colorado dot edu.

IMOD                                4.12.35                     refinematch(1)