Introduction

The CTF Graph

Tool Button Usage

Fitting Parameters Dialog

Angle Range and Tile Selection Dialog

Cropping Spectra, Increasing Spectrum Resolution, and Autotuning

Finding Astigmatism

Finding Phase Shift and Cut-on Frequency

Examples

Summary of Sequence of Steps to Follow

Alternative, Legacy Fitting Methods

This guide gives a comprehensive description of the various features of the Ctfplotter program, which can determine the parameters needed to correct tilt series for the microscope CTF. For starting out, it is recommended that you first go through the first two examples in the CTF tutorial.

Ctfplotter plots noise-subtracted, rotationally averaged power spectra from tilt series data and allows one to determine the position of the zeros of the microscope CTF. The power spectra are obtained by extracting small squares of image (referred to as tiles) that overlap by 50%, taking their 2D Fourier transforms, rotationally averaging the transforms to obtain one-dimensional curves, optionally dividing by the corresponding curves obtained from images consisting only of noise, and summing these 1D curves. The summing is not straightforward when the image is tilted, because each tile is at a different defocus. This figure illustrates how the summing is done.

Each tile is assigned to a strip parallel to the tilt axis, containing tiles at a similar defocus. Spectra are simply summed from all the tiles within a strip. For a strip not at the center, the strip spectrum is then either stretched or compressed so that its expected zero positions will line up with those of the central strip, depending on whether it is at a higher or lower defocus. If the matching of zeros is not done correctly, the peaks and zeros will tend to cancel each other out at high frequencies, especially when there are closely spaced zeros. To do the matching, the program has to assume a defocus value before it computes the spectrum, so the accuracy of the matching depends on how close the assumed defocus it to the actual one. Generally, it will work better if it can work from the current defocus estimate rather than the nominal, expected defocus that the program starts with.

Once defocus is determined from such power spectra, the phase inversions of the CTF can be corrected with the program Ctfphaseflip. Defocus can be found in single images or, if the CTF signal is too weak, it can be found in angular subranges of the tilt series. Astigmatism and phase shift can also be found. The defocus and other values are stored in a table so that they can be visualized, deleted, or recomputed if necessary. All of the values in the table are saved to the defocus file, which is provided as input to Ctfphaseflip.

- The plotter shows graphs of image power as a function of spatial
frequency. The X coordinate is in cycles per pixel (also referred to as
reciprocal pixels).
0.5 equals the Nyquist frequency determined by the pixel size.
If the pixel size is in nanometers, any frequency on the X axis can be
converted to 1/nm by dividing by the pixel size. Below each label in
reciprocal pixels is the corresponding periodicity, or resolution, in
Angstroms.

The Y coordinate is based on the logarithm of image power. - The magenta curve is the logarithm of the power spectrum of the selected views after subtracting the logarithm of the noise floor. If there are no noise files, or an option is selected to turn off this noise subtraction, a line will be fit to the portion of the spectrum past an initial falling phase and that line will be subtracted instead. A baseline from the high frequency part of the curve is also subtracted, so the curve will end up around zero at high frequencies.
- The green curve is the fitted CTF function, based on the values in the magenta between starting and ending frequencies set in the fitting range dialog. The curve is drawn over the whole frequency range.
- To zoom in an area, hold the left mouse button down and
draw a rubber band around that area.

To go back to the previous zoom level, push the Zoom-out icon.

Successive zooms are kept in a list, and you can go forward or backward through the zooms using either the Zoom-in and Zoom-out icons or the standard hot keys for zooming in 3dmod, "-" or "+/=". - Use arrow keys to scroll vertically and horizontally. You can also use the mouse scroll wheel to scroll vertically.
- The text label marked
with "Z" on the top line reports the frequency of the
first zero, either found by fitting to the power spectra, or set by
double-clicking with the left mouse button. The absolute frequency of the
first zero in 1/nm is this frequency divided by the pixel size.

The text label marked with "D" on the top line reports the found defocus in microns.

If you double-click on the position of the second zero with the middle mouse button, the text label marked "D2" shows the defocus implied by that second zero position, and the text label marked "D-avg" shows the average of the defocus from the first and second zeros.

The text label "Error:" shows the error of the fit. This error is the square root of the mean squared difference between the power spectrum and the fitted curve over the fitting range, in the log units of the Y axis. - Double clicking at a point in the plot with the left mouse button will set
the found frequency of the first zero to the frequency at the point.

The found defocus label will change accordingly. This is useful for manually locating the first zero and finding its corresponding defocus.

Once a first zero position is set either by fitting or manually clicking, double-clicking with the middle mouse button can be used to indicate the second zero position. The text labels based on the second zero will be set back to "NA" whenever a new first zero is set. - Double clicking with the right mouse button at a position in X to the right of the first zero will set the end of the fitting range, and double-clicking to the left of the first zero will set the start of the fitting range, provided that the Fitting Parameters dialog is open.
- The
**Alternate colors**checkbox in the lower left corner provide an alternative set of display colors that should work better with some forms of color blindness.

Zoom in again after zooming back out. | |

Zoom out after zooming in. | |

Adding Non-center Tiles button. If this button is enabled, the current estimation is based only on center tiles; push this button to add non-center tiles to the current estimation. | |

Print the plotted curves. | |

Bring up Qt assistant to display this page. | |

Autotune | Automatically find good values for the fitting range and the sampling of the data, as explained below. This tuning can usually be used if the signal is strong enough and there are at least 3 zeros within 2/3 of Nyquist (0.33/pixel). |

More... | Open a pop-up menu that contains entries to 1) scan over a range of defocus values to find the best initial defocus, then try the autotuning procedure; 2) reopen the angle range or fitting parameters dialog if it has been closed; 3) control the use of stored settings between runs of the program, as explained below. |

This dialog presents the parameters for fitting to a CTF-like curve. Additional features in this dialog are described in the sections below on finding astigmatism and finding phase shift.

After changing parameters in text boxes in this
dialog, either press
**Apply** or type the "Enter" key to have the fit
recomputed with the current parameters.

Fitting to a CTF-like curve involves finding four to seven parameters,
depending on the extent of the fit and whether the
option **Vary exponent of CTF function** is selected.
One of the parameters of the curve is the
defocus. The other parameters for a basic fit are an additive factor, a
scaling factor, and the decay rate for an exponential that attenuates the
curve. If the fitting extends to at least halfway between the second and third
zeros, the program adds two more parameters, a scaling
factor and decay rate for a second exponential. This allows the fit to
accommodate both the strong decay of the power spectrum before the first zero
and a weaker decay between successive peaks between the zeros.
decay of the power spectrum
illustrated in one of the examples below.

The fit does rely on an initial approximate value for the defocus and may
fail if the actual defocus is far from that value. It takes
this value either from the **Expected defocus (um)** text field or from the
current defocus estimate, depending on whether the option is selected to use
the **Current defocus estimate** in the Angle Range and Tile Selection
Dialog. That option will be selected for you if the program was started with
a range of defocus values to scan, or after a successful autotuning.
Otherwise, you will generally want to switch to using the current defocus
estimate as soon as you have determined that fitting is working well, since
the program's summing of spectra in tilted images works better with a correct
defocus value, as explained above.
If you do keep using the expected defocus, at least change the value there if it
is not close to the found defocus.

The frequency range over which the spectrum is fit is set from the entries **Start fit at** and
**End fit at**. When the program first starts, it sets these values to be
about 0.03-0.05/pixel before the first zero, and midway between the third and
fourth zeros, respectively, based on the expected defocus. If necessary, you
should adjust
the starting value so that it is to the right of where the fitted curve
strongly deviates from the actual. If there is a strong peak between the first
and second zeros, it is even better if the fitting range starts where the curve
to the left of the first zero is not much higher than that peak, so that the
shape of this left portion does not unduly influence the fit. In general, you
should adjust the ending value
to go as far out as CTF oscillations can be reliably discerned, and even
reduce the ending point if the magenta curve
becomes noisy and falls off before the current end.

The next line of controls provides another way to adjust fitting range.
The **Start** button will reset the **Start fit at** entry based on the
current defocus, which is useful when the actual defocus is not close to the
original expected defocus. The **End** button will set the **End fit at**
entry based on the current defocus at the zero number indicated in the spin box,
which can have fractional values.

The option to **Do auto weighting and truncation** helps avoid the need
to change fitting range at higher tilts, where the high-frequency signal
often deteriorates. With it selected, the program will do a local
correlation between the measured and fitted spectra, make weights that
depend on this correlation, and redo the fit with the weights. The weight
will be set to zero at a high frequency (the fit will be truncated) if the
correlation drops below a threshold. The weight
will also be set to zero below the frequency where the curve is 50%
higher than the peak between first and second zeros.
The weights are drawn with a blue curve with labels for 0, 0.5, and 1 at the right.

The option to **Downweight large amplitude region** will reduce the
weights to as low as 0.5 in the region of the spectrum where the peak
amplitudes are more than half of the amplitude of the peak between first and
second zeros. In principle, this would allow the curve to fit the higher
zeros better if the defocus consistent with that part of the curve is
slightly different from the defocus that fits the early zeros.

The **Baseline fitting order** spin box controls the fitting of a constrained
polynomial to the apparent baseline of the power spectrum at
frequencies past the first zero. This polynomial is then subtracted to
make the baseline be flat. After improvements to this fitting in IMOD 4.10, this
fitting has been turned on by default with an order of 4, except when the
expected position of the first zero is at or beyond half Nyquist, in which
case the default order is 1. An order of 0
turns off this fitting. The order can also be adjusted with hot keys 0, 1,
2, 3, and 4 in the plotter window. If the deviation from baseline is very
small in your data, you can try turning off this
fitting to see if it improves the signal.

The option to **Get initial baseline from 2-line fit** can be helpful in
cases where the noise subtraction leaves a spectrum that slopes badly even
around the first zero and makes it difficult to detect the first zero and
include it in the polynomial baseline. The program fits two lines to the
power spectrum, one from near the start of the spectrum to a point in the
middle, and a second line from the same middle point to the end of the spectrum.
It tries this fit over a range of middle points around the expected position of
the first zero and finds the point where there is the biggest difference between
the slopes of the low and high-frequency lines. This method is always used
for an initial baseline subtraction when there are no noise images, or when the
option described next is selected; in these cases this option is disabled.

The option to **Skip noise subtraction** allows you to turn off the use of
the noise images and rely on the two-line initial fit instead. You can use
this both to find out whether it solves some problems in fitting and to
assess whether you can dispense with noise files in the future.

**Middle tilt angle**

**Number of views to fit**:

The program will include in the power spectrum the number of views specified
in the spin box, with the middle view of that set having the tilt angle
specified the middle angle box. It will adjust the middle angle entry as
necessary to match an existing tilt angle and to be a feasible middle angle
for the selected number of views. The range of tilt angles and view numbers
in the spectrum are summarized in the line below the spin box. Views are
numbered from 1.

**Apply:**

This button causes the spectrum and fitting to be done with the current paramaters.

**Store in Table:**

Push this button to store
the defocus and any other paratmeters found for
the selected views in the angles and defocus table. The defocus
indicated by "D" is stored unless a second zero has been clicked, in which
case the average defocus indicated by "D-avg" is stored. Astigmatism amount
and axis, phase shift, and cut-on frequency will be stored if their values as
a result of fitting show in the plotter window. The table will not show
phase or cut-on values if they are the same for all table entries (i.e., if
they were set from their respective fields for expected
values), although the defocus file will have these values.

**Step view range**:

Pressing **Step Up** or **Step Down** will shift the selected views by
the amount in the **Step view range by** text box.
If this step would make the starting or ending view
go outside the bounds of the
tilt series, the actual step is reduced.
The power spectrum is computed and fit to at the new
angular range. The step size is initialized to be half the original number of views.

**Autofitting**:

Once fitting parameters have been set optimally and an appropriate number of
views to fit has been chosen, the **Autofit All Steps** button can be used to step
automatically to a series of view ranges, find the defocus and optionally
other parameters, and store the defocus in the table.

- The view range for each fit will be that specified in the
**Number of views to fit**spin box, unless the option to fit more views above a certain angle is selected. To use this option, check**Fit**, set the spin box to the number of views to fit (which must be higher than the**Number of views to fit**) and enter an angle in the text box after**views above**. For example, with the default values of 3 and 45, 3 views will be fit at angles higher than -45 and 45 degrees. - Ranges will span the angular extent specified in the
**Autofit:**and**to**text boxes. Specifically, the range at one extreme will start at the angle in the**Autofit:**box and the range at the other extreme will end at the value in the**to**box. These boxes are initialized with the starting and ending tilt angles of the series. - The spacing between view ranges will be approximately that specified in the
**Step view range by**entry, adjusted to span the desired angular extent. - However, if the
**Fit each view separately**checkbox is selected, each image in the desired angular extent will be fit separately, regardless of the step size and the size of the current view range. Fitting to every view separately is generally feasible for electron-counting data from direct electron detectors, in which the high-frequency response is very good. If the option to fit more views at high tilt is selected, this checkbox will be labeled**Fit at every angle; step by 1**to reflect the fact that not every view will be fit separately, but that the step size will be 1 and every possible angle will be used as the middle tilt angle of a fit. - The current settings for
**Which defocus to use**and**Initially use only central tiles**are used in computing and fitting the power spectra. However, if**Use expected defocus**is selected, the program will ask you to confirm (just once) that you want to proceed with that setting. - If the current defocus is selected for use, then the fitting will occur in two directions from the currently selected view range. It saves the current defocus before it starts, and when it reaches the extreme in the the first direction it uses those saved values to resume fitting in the other direction from the starting location. In this way, it can adapt more easily to progressive changes in tilt angle. In this situation, it will do three iterations of the computation and fitting to a final power spectrum to find defocus and possibly phase shift, in order to reach a consistent defocus value.
- If there are already values in the defocus table, the program will ask whether you want to remove or retain ones that are already present in the extent being analyzed. The message will list the middle of the tilt angle range for the first and last one to be removed. If existing entries get deleted, look carefully at the end of the range for ones that might not have been deleted.
- The
**STOP**button can be used to stop the autofitting when the current angle is done. This can be useful if you see it go astray. - The
**Show wedge fits**checkbox in the Fitting Parameters dialog can be toggled at any time during autofitting. You should watch the wedge spectra during the autofitting over any part of the tilt series where there is doubt about whether the wedge fitting might be reliable.

**Expected defocus**:

This field starts out with the expected defocus value
specified in the parameter file, or with the initial value found when defocus
is scanned, but you can change it. Initially, this value
is used to compute the expected frequency of the first zero of the power
spectrum and to set the initial frequency range over which the the power
spectrum is fit.
As explained above, Ctfplotter uses a defocus to
compute shifts needed to align the power spectra of non-center
tiles with the CTF curve of center tiles. With the radio button group
**Which defocus to use**, you can specify
whether to use the expected defocus shown in the **Expected defocus
(um)** edit field or the defocus last found by the
program as the defocus for computing the shifts. In the latter case, the
autofitting behavior is also modified as described above.

**Initially use only central tiles**:

Choose whether to exclude the noncenter tiles from the estimation
when computing the power spectrum. This option should not be needed
with data from modern cameras.

With this checked,
only the center region defined by
**Strip defocus tol** will be
included in the next computation, and the "Adding Non-center Tiles" button
will be enabled. You need to push that button to add the left region
defined by **Left defocus tol** and the right region
defined by **Right defocus tol**
to the estimation.

Otherwise,
all regions (center, left, right) will be included when the curve is
recomputed,
and the "Adding Non-center Tiles" button will be disabled.

**Phase shift fields**:

The **Expected phase shift** text box can contain a phase shift in
degrees. If phase shift is not being determined, this constant phase shift will be
included in all CTF computations. If it is being found, then the value here
sets the center of the phase shift search range.

The **Cut-on frequency** text box can contain a cut-on frequency that is
relevant when a non-zero phase shift is included in the CTF computations.
See the extensive explanation of this cut-on in the section on *Finding
phase shift and cut-on frequency*. If cut-on frequency is not being
determined, the constant value here is included in CTF computations. If it
is being found, this value provides a fallback that is used when searches fail
to find a best cut-on frequency.

When **Use current phase estimate** is checked, phase shift searches will
be centered on the value last found by fitting, and the autofitting behavior
will be modified as described above.

**View skipping and breaking fields**:

These entries control which views are included when spectra are analyzed.
The **Views to skip** field can be used to exclude views either from all
spectra, or only from the spectra used to find astigmatism or phase shift.
If **Skip/break only for astig/phase** is not selected, then the program
will behave as if these views simply do not exist. If it is selected, then
the views will be included in spectra used only for defocus measurements and
their defocus can be determined, but they will excluded from any spectra
used to compute phase or astigmnatism.

When **Break groups at view** is selected and the starting view number of a
bidirectional tilt series is entered in the text box, then groups of views
for computing spectra will be entirely on one side or the other of the
boundary between this view and the next. Again, the
**Skip/break only for astig/phase** option will determine
whether this restriction is applied for all spectra, or just for ones used
to determine astigmatism or phase shift. It makes sense never to group views
across this boundary, since the conditions affecting these parameters could
easily change during the time interval between the two halves of the tilt
series. On the other hand, defocus was probably set by autofocusing at each
view on either side of the boundary, which would have produced no
discontinuity in the values, so there seems to be no problem with combining
views across the boundary when just finding defocus. Note that a tilt
series taken with the dose symmetric ("Hagen") scheme of alternating plus
and minus tilt angles should not be treated as a bidirectonal tilt series
because there is no big discontinuity or long time interval on the two sides
of zero degrees.

The options **Analyze spectra cropped to pixel size** and **Power spectrum
resolution** are covered in a separate section below.

**Tile & wedge parameters**:

The **+** pushbutton will open up a section of the dialog for parameters
that are rarely adjusted. With the program option
"HideAngleTestAndOffset", controls for testing whether tilt angles
need to be inverted and for setting a tilt angle offset will also be included
in this section.
The rarely used items include:

**Strip defocus tol**: Tiles within this tolerance of the defocus at the center of a strip are included in the strip and summed together before adjusting their spectra to add into the full sum. The image region with defocus difference less than this tolerance is also defined as the center region. The small default tolerance of 50 nm is appropriate to prevent blurring of spectra with many zeros, but if you need to sum center tiles only for some reason, you might want to use the old default of 200.**Left defocus tol**and**Right defocus tol**: These two entries set the maximum defocus difference for adding in tiles from image regions to the left and right of the center region, respectively. These entries were useful for testing whether tilt angles needed to be inverted, but now that can be tested directly with the**Test Left-Right Differences**button.-
**Tile size**: the tile size in pixels. Spectra with a large number of closely spaced zeros extending to high frequency may benefit from a tile size larger than the default, but note that the tile size is already made bigger when spectra are cropped. **Tilt axis angle**: The amount in degrees that the tilt axis deviates from being vertical (Y axis)**Wedge interval**: The angular step between successive wedges when finding astigmatism. This is constrained to be a multiple of the underlying sector size, which is 5 degrees by default and can be controlled by an option in the parameter file.

**Testing Left-Right Differences and Finding a Tilt Offset:**

The **Test Left-Right Differences** button will measure defocus separately
from tiles on the left and right sides of center. This can be used in two
ways: to assess whether tilt angles need to be inverted,
and to measure an offset to the tilt angles from the set of views currently
being fit.

- Tilt angles may need inversion if images have been flipped in some way,
which
occurs in the JEOL omega filter and can also happen if frames are saved from a
direct detector without reorientation and are not restored to the proper
orientation when aligned and summed to make the tilt series images. You
should test for inversions if you are working with unfamiliar data and
there is any possibility that it might have been flipped. The test must
be done with tilted images; use 45 degrees if that gives a clean enough
signal, or at least 30 degrees. Fit to at least 3 views for these tests.
When you press the
**Test Left-Right Differences**button, the program will measure defocus on the two sides with the original tilt angles, and with them inverted. It will then give a report that should be clear about whether angles need inversion with the program option for this purpose and haven't been, or have been inverted and shouldn't be. If this is the case, restart the program with the option set differently. - If the specimen is not level at the nominal zero tilt, spectra from
different defoci will not sum optimally at high tilt, potentially blurring
the CTF oscillations at high-frequency. The effect will be minor if the
tilt is a few degrees off, but could be substantial for a FIB lamella where
the tilt angle offset has not been adjusted in the tomogram positioning
step. You need data with strong CTF signal to detremine the offset. For a
single measurement from the current views, the
**Middle tilt angle**must be less than 10, and you should fit to at least 3 views. When you press the**Test Left-Right Differences**button, the program will use the defocus difference between the two sides to estimate what tilt offset should bring the difference to zero. Although you could insert this offset in the**Tilt angle offset**text box and refine it by iterating, it is more accurate and easier to use the offset assessment described next.

When you press **Assess**, the program will find left-right differences
in up to 5 sets of views
around the current **Middle tilt angle**, using views up to 17 degrees
and making these sets of views non-overlapping to the extent possible.
Each fit will include 3 views or the **Number of views to
fit** if it is higher than 3. If astigmatism is currently being found
and it is less than 0.2 micron, it will be omitted from these fits because
it gives slightly more variable results when included.
After finding the mean tilt offset implied by these fits at different
angles, the program
will iterate the procedure up to two more times, stopping if the change in
offset is under 0.5. A message will pop up with a summary of the results,
for example:

Tilt angle offsets for each iteration of assessment: for mid-angles: -13.0 -7.0 -1.0 8.0 14.0 1: Initial 0.0 Measured mean: -2.0 SD: 1.29 New: -2.0 2: Initial -2.0 Measured mean: -0.6 SD: 1.28 New: -2.6 3: Initial -2.6 Measured mean: -0.2 SD: 1.28 New: -2.8First it lists the angles of the sets of views. Then for each iteration, it shows the initial value, the mean and standard deviation of the estimates of additional offset, and the new offset that was applied, if any. If the values oscillate, it may say that the offset was restored to what it was initially or after the first iteration.

For typical SD values of 0.7 - 2.0, the tilt offset can usually be found with an accuracy of ~0.5-1 degree; but sometimes the SD will be much higher. If it is very high (say, above 4), it may be better to zero out the offset unless one is expected. This offset is used solely to improve summing in this program and is not passed on to the reconstruction process.

**Angles and Defocus Table:**

This table shows the starting and ending tilt angle,
the middle of the angular range, and the defocus value for each range where
you have stored results. The lines are in order by the middle of the angular
range. When you store a value for an angular range matching that of an
existing line in the table, the existing defocus value is replaced with the
new one. When the program starts, this table is loaded with values from an
existing version of the output file. Below the table are three buttons that
operate on the table:

Push the **Delete Row** button to delete the entry for the currently
selected row of the table. If you store
results for an angular range and then want to replace them with results from a
wider or narrower range, you would need to delete the row with the initial
results.

Push the **Set Tilt Angles** button to reset the middle tilt
angle and number of views to fit to the values implied by the currently selected row
of the table and recompute the power spectrum. To conveniently step through a
series of angular ranges,
click the mouse anywhere on a row to select that row of the table.
Then press the **Set Tilt Angles** button with the mouse, or using the
keyboard accelerator Alt-T. Thereafter, you can type an up
or down arrow key to move up or down in the table and press this button again,
without moving the mouse. Alternatively, you can double click in the table to
select a row and have its power spectrum displayed.

Push the **Graph Values** button to open separate windows with graphs of
all the determined values in the table
versus tilt angle. The graphs can be closed with the close buttons in their
title bars. They need not be closed before opening another set of graphs.

Push the **Save to File** button to write the contents of the angles and
defocus table to the output file.

Push the **Save PNG** button to save an image of the current graph as a PNG
file. A file chooser will open for defining the output file name; the default
name is the root name of the input stack plus "_ctfp" plus the tilt angle(s) of
the fitting range.

Push the **Save Many PNGs** button to save PNGs of the graphs for some or
all of the CTF fits stored in the table. A dialog will open for you to enter
the row interval at which to save the graphs, i.e., 1 for every row, 2 for
every other row, etc. Each file is named with the root name of the input
stack plus "_ctfp" plus either the starting and ending angles of the fitting
range or just the tilt angle for a fit to a single view.

When the pixel size is small (under ~0.3 nm), the spacing between higher-order
zeros may become too small to represent the spectrum well. When this happens,
**Analyze spectra cropped to pixel size** can be turned on to spread
out the power spectrum by cropping off the high frequencies. This cropping
can be helpful even when the higher frequencies do not initially appear to have usable
signal.
The text box for the new pixel size is initialized with the actual
pixel size of the data set and is constrained to containing higher values.
No cropping occurs unless you enter a higher pixel size. The same improvement
in ability to represent the oscillations can be achieved by increasing the
value of the **Power spectrum resolution** (the number of points).
Cropping is preferred over increasing the resolution, primarily to stretch
out the spectrum and make it
easier to visualize, and partly to avoid sampling too finely from the tile
FFTs. However, beyond a certain point, cropping will chop off useful
signal, and the resolution must be increased instead.

The following sequence of spectra are from an image with quite strong high-resolution signal and illustrate this situation clearly. This tilt series is the TS_43 data set of Schur et al., 2016, Science 353:506-598, from EMPIAR 10164. It had a pixel size of 0.135 nm and a defocus of 2.5 microns. This is the spectrum right after starting the program, with a fitting range ending at 0.115/pixel.

There are two possible signs that the spectra need to be cropped, aside from the small pixel size in itself. One is a fitted (green) curve that becomes quite jagged, with irregular and modulated amplitudes. In the snapshot, the curve looks like it has only two points per zero at about 0.17/pixel, is damped down inappropriately between 0.17 and 0.21/pixel, and then above 0.21/pixel the oscillations resume but become inappropriately farther apart instead of closer togther. These features are all a result of there being too few points to represent this curve properly (referred to as CTF aliasing), and the actual spectrum would share this problem. The second sign is an output line in the blank space below the spectrum resolution entry indicating what cropping or resolution change would be needed to have a particular number of points between zeros. Specifically, in this case, after the fitting range was set to 0.17/pixel, the message was "Crop to 0.197 nm to have >= 3.5 points/zero in fitting range", and it was shown in red because the needed pixel size was so far from the current one.

Setting the cropping pixel size to 0.2, turning on the option to crop, and setting the fitting range to end at 0.375/pixel gave the following, greatly improved curve.

When the cropping is enabled or changed, the meaning of the frequency units changes: notice that 0.5/pixel has gone from being 2.7/Angstrom to 4.0/Angstrom. Also, the fitting ranges in the Fitting Parameters dialog, which are in reciprocal pixels, are changed to maintain the same actual frequency in reciprocal nanometers; in this case the range changed to 0.255/pixel, but the resolutions in Angstroms next to the fitting range values stayed the same. Notice that the fitted curve has a regularly declining amplitude out to ~0.37/pixel and the actual spectrum shows clearer oscillations as well. The fitting range was thus changed to 0.375/pixel. In response, the cropping suggestion, still in red, changed to "Set PS resolution to 122 and crop to 0.251 for >= 3.5 points/zero". If this suggestion is followed exactly it gives:

The frequency 0.5/pixel has changed to be at 5.0/Angstrom and the end of the
fitting range changed to 0.47/pixel. There is still a message,
"Set PS resolution to 124 to have
>= 3.5 points/zero in fitting range", now in magenta because the
change is small enough to skip. If the conditions have already been
achieved, the message will appear in green but stay there as a reminder. This
iterative procedure is done automatically by the autotuning operation
invoked with the **Autotune** button right after starting, which gives this:

The tuning resulted in a cropping to 0.239 nm and a resolution of 136, giving
well-resolved oscillations out to Nyquist. The fitting range was left at
0.081 to 0.478/pixel, the option to **Do auto weighting and truncation**
was turned on, and the option to use the **Current defocus estimate** was
selected. The vertical scaling was set to fill most of the range in the graph.

Cropping can be important for a good fit to the high frequency data, but there is a bit of a Catch-22 here: you may need to try cropping in order to see that there is good signal in the range where the cropping matters. If you cannot use autotuning, it is recommended that you routinely try cropping to ~0.2 - 0.25/pixel when the pixel size is smaller than that. However, spreading out the spectrum will result in less averaging in each frequency bin and thus a noisier spectrum, so at some point the cropping will become counter-productive. Use the minimum increase needed to make the spectrum easier to fit or visualize.

Ctfplotter can find astigmatism by making power spectra that are rotationally averaged over a wedge of 2-D Fourier space. It fits to a series of such spectra at the full range of wedge orientatons. For example, with the default parameters, it computes the spectrum from a 90 degree wedge, which is half of frequency space, with the center of the wedge oriented at -90, -85, -80, etc. up to 85 degrees. It is able to compute these overlapping wedge spectra very efficiently because frequency space is divided into small, non-overlapping sectors (5 degrees by default) and rotationally averaged spectra are stored separately for each sector.

Each wedge spectrum is fit to a CTF-like curve to its defocus. When there is astigmatism, this defocus will vary consistently between the low and high defocus axes of astigmatism. The difference between maximum and minimum measured defocus values will be less that the actual astigmatism because these broad wedges average over a range of angles and defocus values. A search is done to find the underlying astigmatism amount and axis angle that best fit the set of measured defocus values. If the program determines that astigmatism is large enough that it could blur out the higher zeros within the fitting range when summing over 90 degrees, it will iterate the process, this time accounting for the estimated astigmatism when summing the individual wedge spectra. If the estimate changes enough, it will iterate again.

The wedge spectra will be computed over the maximum of the number of views being
fit for defocus and the number specified with the **Min views for
astigmatism** spin box. It is generally appropriate to compute the wedge
spectra over more views than being used for defocus, for two reasons: 1)
Each wedge spectrum is based on less data than the full spectra for
measuring defocus (e.g., half as much for 90
degree wedges), so if a certain number of views need to be averaged to get
reliable defocus estimates, more views (twice as many for 90 degree wedges)
are needed to get wedge spectra with the same signal-to-noise ratio. 2)
Even when there appears to be good enough signal to measure defocus and astigmatism on
each view (as in the example below), the view-to-view variability in the
estimated defocus will be reduced by averaging over multiple views. Since
astigmatism would be expected to vary slowly through the tilt series, most
variations from view to view are unlikely to be real and it is appropriate
to reduce them.

When the program computes wedge spectra for finding astigmatism, it will
display each spectrum and its fit as long as the **Show wedge fits**
option is turned on. You should always have this on when you start finding
astigmatism so that you can assess how reliable the astigmatism fits are.
Watch out for jumps in the fitted curve; one or two can be tolerated because
there is robust fitting that can discard them, but if there are more than that,
average the wedge spectra over more views. The top line of output
shows the fitted defocus and the second line will show "Wedge:" and the
center angle of the wedge. If necessary, you can put
a longer delay time in the text box after **Show wedge fits for**. Also
watch for dramatic changes in the shape of the spectra, such as the dip at
the first zero becoming much wider at some angles; such changes can make the
astigmatism estimate quite inaccurate.

After finding astigmatism, the plotter window shows a second line of numbers: "Astig:" and the astigmatism in microns; "Axis:" and the angle of the high-defocus axis of astigmatism in degrees; "Wedge err:" and the error from fitting the defocus values, in microns. This error, in microns, is the square root of mean squared error between the measured defocus values and the curve of values expected from the given wedge size and the fitted astigmatism and defocus.

The dependence of the astigmatism estimate on the wedge size has been evaluated by averaging over sets of 10 views for several sample data sets, and by analyzing some high-exposure images from carbon film. No significant dependence was found. Thus, athough you could use a wedge size below 90 with particularly strong CTF signals, there is no real reason to do so. You can increase the wedge size to 120 if that is needed for more SNR.

After astigmatism is determined from the required number of views, the program then assumes that astigmatism when making the spectrum used to find defocus. It composes this spectrum by adding up data from non-overlapping wedges of frequency space, where each wedge spectrum is adjusted for the defocus at its angle before adding into the sum. The final defocus value is the one determined by fitting to this spectrum.

If astigmatism is large enough to cause blurring of zeros in the wedge spectra within the range of frequencies being fit, then the program will iterate, using the initial value of astigmatism to divide each fixed-width wedge into sub-wedges of sufficiently uniform defocus. Iterating in this way eliminates the potential bias in the astigmatism solution from using broad wedges for the analysis. If you are watching the spectra, you may see several rounds of fitting when astigmatism is large.

Ctfplotter can also find the phase shift from a phase plate. It requires
several well-defined zeros in the spectrum to find both defocus and phase
shift reliably. Phase shift is determined with a separate search;
specifically, the phase shift is varied and at each value of phase shift,
a CTF-like curve is fit to the spectrum; the phase shift is picked that
gives the minimum error in that fit. The search is done over the range of
phases entered into the **Phase search range (deg)** text box, centered
on the value in the **Expected phase shift** text box in the Angle Range
and Tile Selection dialog.

Just as for astigmatism, more views can be used to find phase than to find
defocus; the number of views used to find phase is the maximum of the number
for finding defocus and the number set in the **Min views for phase**
spin control. When more views are used to find phase, a spectrum is
computed first from that number of views, phase is found, the spectrum is
computed for the smaller number of views needed for defocus, assuming that
phase value, and then defocus is found from that spectrum, with phase fixed
at the found value. When the same number of views are used for each, a
single spectrum is computed for finding both parameters. However, when both
astigmatism and phase shift are being found, there may be up to three
rounds of spectra with different numbers of views.

If there are many zeros and the CTF does not closely match what the CTF
equations predict with phase shift, the fit curve may get off at high frequencies
because the much stronger signal from the first few zeros dominates the
fit. A more balanced solution that fits better at the high frequencies
can be obtained by selecting the **Find and fit to zero positions**
option. With this option, the program finds minimum points in the spectrum by
correlating the spectrum around each point with a segment of the expected
CTF function. It then searches for the defocus and phase that best fit this
set of positions, minimizing an error weighted by the strength of the
correlation at each zero. The fit will be better at the high-frequency
zeroes but the CTF-like curve may deviate noticeably around the first zero.
This method requires at least 3 zeros. If the search fails, or there are
fewer than 3 zeros, the program falls back to finding the phase that
optimizes the usual fit of the CTF-like curve to the spectrum.

After finding phase, the second line at the top of the plotter window will show "Phase:" and the value in degrees, or "FAIL" if the search failed. When fitting to zero positions, the label "Err:" on the top line will be shown as "ZF err:" and the value will be the mean deviation of the fitted zero positions in reciprocal pixels (specifically, the weighted sum of squared deviations in position is divided by the number of zeros, and the square root is taken).

Two problems particular to finding phase shift may arise. One is that the
first zero may rise up above the later zeros at high tilt. The easiest
way to handle this problem is to set the start of the fitting range past the
hump after the first zero, which should work well if there are
numerous zeros and good signal. The position of a minimum on a falling part
of the spectrum is shifted by the underlying slope, so it is better to leave
the zero out of the fitting. If fitting past the first zero is problematic,
try to get the first zero down.
First make sure that the fitting is starting with approximately correct
values of defocus and phase shift. For defocus, either adjust **Expected
defocus** if that is what is being used, or make sure that the last found defocus is
approximately correct if the current defocus is being used. Double click to
set a good defocus value, if necessary. Adjust the **Expected phase
shift** to the last known good value and turn off **Use current phase
shift**. Repeat the fitting. If you are using noise files, you also can also try
toggling **Get initial baseline from 2-line fit**.

The second problem may become evident with many zeros. If the minima of the
fitted curve are consistently off from the minima of the spectrum at one end
or the other, even when fitting directly to zero positions, you may need to
determine a cut-on frequency
as well. With a cut-on frequency, the phase is modeled as rising
exponentially from zero at zero frequency to its true value at high
frequency. This is difficult to solve for since it produces relatively
small deviations in the spacing between zeros from a model with no cut-on
frequency. The error when fitting either the spectrum or zero positions is
rather insensitive to the cut-on frequency, so the search needs to find the
minimum in a long, narrow trough with a shallowly sloping floor. The
program scans the full range of cut-on frequencies from 0 to the value in
the **Maximum cut-on (1/nm)** text box at a regular interval, for each
value performing a full search for the best phase and defocus. Then it
refines the search around the minimum, again doing the full search at each
cut-on frequency being tested.

This search is activated by selecting "Find cut-on frequency also". Before
doing so, you can assess whether a cut-on frequency helps the fit by
entering some values in the **Cut-on frequency (1/nm)** text box in the Angle Range
and Tile Selection dialog. Try values like 0.05, 0.1, etc up to the
maximum cut-on shown in the text box. If this does not improve the
correspondence between actual and fitted minima to some degree, there
is no point in trying to search for a value. Also, do not try this search
if there are fewer than 4 zeros to fit.

When fitting to a spectrum, this exhaustive 2-D search is now the most
time-consuming operation in Ctfplotter. Searches with zero positions are
much quicker, but require at least 5 zeros. As for phase alone, if fitting
to zero positions is selected and there are too few zeros or the search with
zeros fails, the program falls back to fitting the spectrum. Which way it
fit is still indicated by whether the error is labeled "Err:" (in log power
units) or "ZF err:" (in fequency units). If both kinds of fitting fail to
find a minimum, the program will then fall back to finding phase only, and
assuming a fallback value for cut-on frequency. This will be either the
last cut-on frequency found, if **Use current phase estimate** is
checked, or the value in the **Cut-on frequency** text box if it is
non-zero, or the value stored for nearby angles in the defocus table, if
any, or simply 0. The value used will be shown afer "Cuton:" in the plotter
window with an "FB" after it to indicate that it is a fallback. However, if
the search for phase only fails as well, both "Phase:" and "Cuton:" will be
followed by "FAIL".

Whenever the cut-on frequency is non-zero, the phase values displayed here and saved in the defocus file will be the phase at one particular frequency, 0.3/nm, rather than the phase actually used in the CTF equation, the phase value at infinite frequency. This convention was introduced in order to prevent the phase values from varying widely from view to view, which they will otherwise do because the cut-on frequency is not found very accurately and the phase at infinity would covary with it.

Ctfplotter saves settings when it exits: it saves a file "ctfplotter.info" in
the data set directory, and a "global" copy in a file ".ctfplotter.info" in your home
directory. When the program is restarted for a data set, it will load the
local file and virtually all settings should be the same as when you closed
program. However, there is a complication: many of the same items could be
specified in the command file. When restarting, these specified entries take
priority, and only the settings that do not conflict with them are loaded from
the file. In the popup menu opened with the **More...** button, there is
an entry "Apply Local Settings that Replace Entered Options" that will load
the rest of the settings. If you want to use the settings in the global file
(which is just the settings from the last run of the program), you can use
either
"Apply Global Settings that Do Not Replace Entered Options" to get just the
settings that would be reloaded automatically from a local file, or
"Apply All Global Settings" to take all the settings. The global settings are
primarily useful when starting a new data set. Finally, the menu has an entry
"Discard Settings on Exit" that will leave both the local file (if any) and
the global file unmodified.

**The first example** shows the appearance of the plotting window with a tilt series
from the ventral disk of Giardia, taken with a Gatan K2
camera in an electron-counting mode at a nominal defocus of 6 microns. This
is the initial spectrum over -5.1 to 2.7 degrees.

The range of the display in Y is dominated by the power at low frequencies, so it is necessary to zoom the display. This graph was zoomed by pressing the left mouse button with the cursor under the hump in the magenta curve, one third of the way up from the apparent baseline (at ~0.12 in X, and ~0.15 in Y, less than half of the way between the grid lines at 0 and 0.4), then dragging the mouse to just below the curves and out to near the right edge to set the lower right corner of the rubber band. Then the window looks like this:

The top line shows that the fitted defocus is fairly far from the expected value of
6.0. As a result, the start of the fitting range, initially set to 0.14, is
at a lower frequency than appropriate. Also, the third zero is fairly well
defined in this plot, so the end of the fitting range, initially 0.365, is
too low. After changing to **Current defocus estimate** in the Angle Range
dialog, setting the end of the range to 0.4 in the Fitting Parameters dialog,
and pressing
the **Start** button, which changes the start to 0.17, the graph looks like this:

The next step is to see how many views need to be fit at once. This is done by
clicking the **Number of views to fit** spinner repeatedly. When it gets
to 1, the spectrum
is still fairly clear and fits well:

Still fitting to a single view, one can then step through and sample some
higher tilt angles easily with the **Step Up** and **Step Down**
buttons. The step size was initially set to 11 views, and this
is adequate for sampling. At 61 degrees the fitting is still good:

Autofitting could now be done, but it is worth assessing the ability to find
astigmatism first. After returning to the initial tilt angle (-1.2 degrees)
and turning on **Find astigmatism**, the final graph looks like this:

The astigmatism turns out to be quite large, 0.65 microns, and accounting for
it gives a spectrum where the CTF signal goes nearly all the way out to 0.5. The end
of the fitting range can even be set to 0.45. Now autofitting to every view
is quite appropriate.
This is accomplished by turning on
the **Fit each view separately** check box and then pressing the button now
labeled **Autofit All Single Views**. The table is filled in as the
autofitting proceeds, first from low tilt to negative angles then from low tilt to
positive angles. Pressing **Graph Values** opens separate graphs for
defocus, astigmatism amount, and astigmatism axis.

Astigmatism is being found fairly accurately, as indicated most strongly by
the consistency in the axis angle. There are clearly some trends in both the
amount and the angle of astigmatism, but the view-to-view changes are probably
mostly measurement error. This variability is ~25% larger with **Min views for
astigmatism** set to 3 instead of 5 and ~2 times larger with it set to 1
instead of 3. Note that when astigmatism is very small (~0.05 micron),
the axis angle cannot be found very accurately, and that accuracy does not
matter so much because the effect of an error on the eventual CTF correction
become small. Thus, consistency of axis angle cannot be used to judge the
accuracy of finding astigamtism itself. In the extreme case, expect wild
swings in axis angle when the astigmatism is under ~0.02.

**The second example** is from microtubules decorated with Eg5, taken with a DE-12
direct detector camera at a nominal defocus of 6 microns. This shows the
spectrum and CTF-like fit for an angular range of -4.7 to 3.2 degrees, after
zooming up and switching to using the current defocus estimate.

The fitting range here was 0.105 to 0.255/pixel, and the start needed to be changed because
the defocus is different from the nominal value.
Changing the fitting range to start at
0.12/pixel hardly changed the appearance, however.
With this data set, it was possible to fit ranges
of 8 degrees, although the fits became somewhat noisy at one end
of the tilt range, but the data were too noisy to allow reliable fitting to
every individual image. In this part of the wedge spectra needed to find astigmatism
can be fit well enough over the same set of 5 views. Turning on **Find
astigmatism** and accounting for the rather sizeable astigmatism gave
clear signal out to the fourth zero in some parts of the tilt range, as here
for -14.6 to -6.7 degrees:

The fitting range was changed to end past the fourth zero, at 0.315/pixel, and **Do
auto weighting and truncation** was turned on so that the range
would automatically be reduced when the signal is less clear. For
example, back at the original tilt range around zero degrees, the signal
between third and fourth zeros is much weaker and the weights indicated by
the blue curve fall to zero by 0.27/pixel.

At the higher positive tilts, the wedge spectra become quite shallow at some
wedge angles, so it is necessary to increase the **Min views for
astigmatism** to 40 there.

**The third example** shows results with a tilt series
from bovine papilloma virus, taken at a nominal defocus of 3 microns and a
pixel size of 0.76 nm. These data were taken on a CCD camera and there is
little useful signal past the first zero. When the program is started with
the old default
angular range of -20 to 20 in the command file, the window looks like this:

This graph was zoomed by pressing the left mouse button with the cursor just above the second low hump in the magenta curve (at ~0.13 in X), then dragging the mouse to just below the curves and just to the left of 0.4 to set the lower right corner of the rubber band. Then the window looks like this:

Now we can see more clearly that the background subtraction is giving a
reasonable power spectrum that is close to flat at high frequencies and that has a
discernable dip, but the green
curve does not fit very well. In the Fitting Parameters dialog, we
see that it is fitting from 0.215 to 0.39, a range that was determined from the
nominal defocus but is not quite appropriate for the actual defocus. The
range was changed by moving the left side
to 0.185 to include more of the falling phase of the power spectrum, and reducing
the right side to 0.29 because the power spectrum drops off after that
point, well before its second zero. At this point it is also clear that the
actual defocus is different from 3 microns, so we select the **Current
defocus estimate** radio button in the Angle Range dialog so that the
shifting from non-centered tiles will be more accurate.
If the fitting were unstable, a better way to do this would be to
change the **Expected defocus** entry.
After recomputing the curves and zooming the display again, it looks
like this:

Here we see that the
CTF-like fitting works fairly well near the bottom of the dip, and that it
leads to a defocus estimate significantly different from the nominal defocus.
Turning on the **Vary exponent of CTF function** gives a slightly different
fit:

This extra parameter does not improve the fit of the curve to the dip, so it is better to leave it off. When using large steps in the view range, it is best simply to step through the whole tilt range to assess whether the fitting works at all tilts. The dip at the first zero remains well-enough defined when stepping to the negative end of the range, but at the positive end of the range the dip is barely perceptible:

The dip can be improved by skipping the first 3 views, which makes the tilt
range on plus side close to that on the minus side. When "1-3" is entered
into the text box for **Views to skip**, the program adjusts the view range
to go from 16 to 58 degrees, which gives this curve:

**Autofit All Steps** can now be
used over the full extent of the tilt series, after which
the angle dialog looks like this:

- Start the program and see the initial fit to the starting range of angles (the default is an ~8 degree range).
- Autotune if possible and skip to step 7.
- Zoom up the graph to expand the portion of the spectrum with CTF oscillations and to exclude useless frequencies.
- Revise the start of the fitting range if necessary, and set the end of the fitting range to the end of the visible CTF oscillations.
- Switch to using
**Current defocus estimate**. - Turn on
**Do autoweighting and truncation**. - Drop the
**Number of views to fit**to as low as possible, hopefully 1. - If the weighting curve drops to 0 for a ways before the end of the fitting range, adjust the end of the range to exclude frequencies where the oscillations are now lost in the noise. (Remember the right-mouse double-click). Otherwise, just let the automatic truncation take care of the range.
- If you did not autotune: If you see the signs of needing to crop spectra to a bigger pixel size, determine the minimum cropping needed; or if your pixel size is under 0.25 nm, try some cropping to ~0.25 nm anyway to see if it improves the representation of the spectrum. Revise the end of the fitting range again if appropriate.
- If you have strong CTF signal and there is no basis for it being strongly directional, you can just go directly to the plus and minus high tilts to check the fitting there, then skip to step 14.
- Otherwisem, set the
**Step view range by:**value to whatever interval you want for stepping to high tilt. - Use
**Step Up**to examine the fit at higher views, then go back to 0 tilt and use**Step Down**to go to lower views. - If there is a tilt range where the signal becomes significantly weaker and the defocus cannot be found reliably at that weak spot, you will have to increase the number of views to fit at least for that region of the series.
- Return to 0 tilt and turn on
**Find astigmatism**. - Watch the curves as they flicker past; if some fits look wrong,
increase
**Min views for astigmatism**until this fitting is reliable. - Go to the part of the series with the weakest signal and make sure
astigmatism fitting still works there; this may entail increasing
**Min views for astigmatism**. - If astigmatism is significant, the zeros may now be clearer at higher frequencies; revise the end of the fitting range if they extend past that end.
- Check
**Fit each view separately**if the number to fit is 1, otherwise set**Step view range**to half the number of views being fit. - Turn off
**Show wedge fits**or set the interval to a very small value like 0.001. - Press the
**Autofit All**button. - When done, press
**Graph values**to examine overall results; double-click in the table to see the spectrum for an angle with suspicious-looking values.

Originally the program contained two additional fitting methods for data with very poor CTF signals, These are still available and will show up with the option "ShowLegacyFitting 1"; they are illustrated here.

You can fit a polynomial to the region around the first zero.
The
The **Order of polynomial** spin button allows you to select an order
between 2 and 6, which involves finding 3 to 7 parameters. The goal here is
to get a smooth curve through the dip; the minimum
of the curve is taken as the location of the first zero.

As for CTF-like fitting, the range of the curve is set from the entries
**X1 Starts** and **X2 Ends**. Since you are just trying to localize
the dip at the first zero, you should restrict the range as necessary to get a
good fit there.

Finding the zero at the intersection of two curves involves fitting two separate curves, before and after the first zero. Each can be fit to either a straight line or a Gaussian over the selected range. The program finds the intersection of the two curves, if possible, and assigns that as the first zero.

X1 sets the fitting range for the curve before the first
zero, drawn in green. Use the **X1 fitting method** radio
button to select whether to fit to a straight line or to a Gaussian.

X2 sets the fitting range for the
curve after the first zero, drawn in blue. Use the **X2 fitting method**
radio button to
fit to a straight line or to a Gaussian.

Although there is no need to try the different fitting methods with this data set, they are illustrated next.

This panel shows the power spectrum for the initial angular range with a fourth-order polynomial fit to the frequency range shown in the snapshot above where the dialog was set to fit a polynomial. As is typical of polynomials, the green curve goes off wildly outside the fitting range.

This panel shows the power spectrum with determination of the zero from the intersection of two curves, with the frequency range as shown above when the dialog was set to find an intersection.

Refer to Ctfplotter man page