.. DO NOT EDIT. .. THIS FILE WAS AUTOMATICALLY GENERATED BY SPHINX-GALLERY. .. TO MAKE CHANGES, EDIT THE SOURCE PYTHON FILE: .. "auto_examples/transform/plot_tps_deformation.py" .. LINE NUMBERS ARE GIVEN BELOW. .. only:: html .. note:: :class: sphx-glr-download-link-note :ref:`Go to the end ` to download the full example code. or to run this example in your browser via Binder .. rst-class:: sphx-glr-example-title .. _sphx_glr_auto_examples_transform_plot_tps_deformation.py: ========================================== Use thin-plate splines for image warping ========================================== To warp an image, we start with a set of source and target coordinates. The goal is to deform the image such that the source points move to the target locations. Typically, we only know the target positions for a few, select source points. To calculate the target positions for all other pixel positions, we need a model. Various such models exist, such as `affine or projective transformations `_. Most transformations are linear (i.e., they preserve straight lines), but sometimes we need more flexibility. One model that represents a non-linear transformation, i.e. one where lines can bend, is thin-plate splines [1]_ [2]_. Thin-plate splines draw on the analogy of a metal sheet, which has inherent rigidity. Consider our source points: each has to move a certain distance, in both the x and y directions, to land in its corresponding target position. First, examine only the x coordinates. Imagine placing a thin metal plate on top of the image. Now bend it, such that at each source point, the plate's z offset is the distance, positive or negative, that that source point has to travel in the x direction in order to land in its target position. The plate resists bending, and therefore remains smooth. We can read offsets for coordinates other than source points from the position of the plate. The same procedure can be repeated for the y coordinates. This gives us our thin-plate spline model that maps any (x, y) coordinate to a target position. .. [1] Wikipedia, Thin plate spline https://en.wikipedia.org/wiki/Thin_plate_spline .. [2] Bookstein, Fred L. "Principal warps: Thin-plate splines and the decomposition of deformations." IEEE Transactions on pattern analysis and machine intelligence 11.6 (1989): 567–585. :DOI:`10.1109/34.24792` https://user.engineering.uiowa.edu/~aip/papers/bookstein-89.pdf Correct barrel distortion ========================= In this example, we demonstrate how to correct barrel distortion [3]_ using a thin-plate spline transform. Barrel distortion creates the characteristic fisheye effect, where image magnification decreases with distance from the image center. We first generate an example dataset, by applying a fisheye warp to a checkboard image, and thereafter apply the inverse corrective transform. .. [3] `https://en.wikipedia.org/wiki/Distortion_(optics)#Radial_distortion `_ .. GENERATED FROM PYTHON SOURCE LINES 53-119 .. image-sg:: /auto_examples/transform/images/sphx_glr_plot_tps_deformation_001.png :alt: plot tps deformation :srcset: /auto_examples/transform/images/sphx_glr_plot_tps_deformation_001.png :class: sphx-glr-single-img .. code-block:: Python import matplotlib.pyplot as plt import numpy as np import skimage as ski def radial_distortion(xy, k1=0.9, k2=0.5): """Distort coordinates `xy` symmetrically around their own center.""" xy_c = xy.max(axis=0) / 2 xy = (xy - xy_c) / xy_c radius = np.linalg.norm(xy, axis=1) distortion_model = (1 + k1 * radius + k2 * radius**2) * k2 xy *= distortion_model.reshape(-1, 1) xy = xy * xy_c + xy_c return xy image = ski.data.checkerboard() image = ski.transform.warp(image, radial_distortion, cval=0.5) # Pick a few `src` points by hand, and move the corresponding `dst` points to their # expected positions. # fmt: off src = np.array([[22, 22], [100, 10], [177, 22], [190, 100], [177, 177], [100, 188], [22, 177], [ 10, 100], [ 66, 66], [133, 66], [ 66, 133], [133, 133]]) dst = np.array([[ 0, 0], [100, 0], [200, 0], [200, 100], [200, 200], [100, 200], [ 0, 200], [ 0, 100], [ 73, 73], [128, 73], [ 73, 128], [128, 128]]) # fmt: on # Estimate the TPS transformation from these points and then warp the image. # We switch `src` and `dst` here because `skimage.transform.warp` requires the # inverse transformation! tps = ski.transform.ThinPlateSplineTransform() tps.estimate(dst, src) warped = ski.transform.warp(image, tps) # Plot the results fig, axs = plt.subplots(1, 2) axs[0].imshow(image, cmap='gray') axs[0].scatter(src[:, 0], src[:, 1], marker='x', color='cyan') axs[1].imshow(warped, cmap='gray', extent=(0, 200, 200, 0)) axs[1].scatter(dst[:, 0], dst[:, 1], marker='x', color='cyan') point_labels = [str(i) for i in range(len(src))] for i, label in enumerate(point_labels): axs[0].annotate( label, (src[:, 0][i], src[:, 1][i]), textcoords="offset points", xytext=(0, 5), ha='center', color='red', ) axs[1].annotate( label, (dst[:, 0][i], dst[:, 1][i]), textcoords="offset points", xytext=(0, 5), ha='center', color='red', ) plt.show() .. rst-class:: sphx-glr-timing **Total running time of the script:** (0 minutes 0.234 seconds) .. _sphx_glr_download_auto_examples_transform_plot_tps_deformation.py: .. only:: html .. container:: sphx-glr-footer sphx-glr-footer-example .. container:: binder-badge .. image:: images/binder_badge_logo.svg :target: https://mybinder.org/v2/gh/scikit-image/scikit-image/v0.24.0?filepath=notebooks/auto_examples/transform/plot_tps_deformation.ipynb :alt: Launch binder :width: 150 px .. container:: sphx-glr-download sphx-glr-download-jupyter :download:`Download Jupyter notebook: plot_tps_deformation.ipynb ` .. container:: sphx-glr-download sphx-glr-download-python :download:`Download Python source code: plot_tps_deformation.py ` .. only:: html .. rst-class:: sphx-glr-signature `Gallery generated by Sphinx-Gallery `_