9.6 Shape and Stereo from Panoramic Views, Stereo from Omnidirectional Images, Plenoptic

Chapter Contents (Back)
Stereo, Omnidirectional. Stereo, Panoramic. Panoramic Views. Shape from Panorama. See also Omnidirectional and Panoramic Sensors.

Adelson, E.H., and Wang, J.Y.A.,
Single Lens Stereo with a Plenoptic Camera,
PAMI(14), No. 2, February 1992, pp. 99-106.
IEEE Abstract.
IEEE DOI BibRef 9202
Earlier:
A stereoscopic camera employing a single main lens,
CVPR91(619-624).
IEEE DOI 0403
The technique to use a lenticular array of lenses to produce a different kind of image, effectively giving multiple cameras with one. Also includes the historical references. BibRef

Ishiguro, H., Yamamoto, M., and Tsuji, S.,
Omni-directional Stereo,
PAMI(14), No. 2, February 1992, pp. 257-262.
IEEE DOI BibRef 9202
Earlier:
Omni-directional Stereo for Making Global Map,
ICCV90(540-547).
IEEE DOI Panoramic Views. A panoramic image is taken and used in stereo analysis then the results are integrated over several loactions. BibRef

Zheng, J.Y., and Tsuji, S.,
Panoramic Representation for Route Recognition by a Mobile Robot,
IJCV(9), No. 1, October 1992, pp. 55-76.
Springer DOI BibRef 9210
Earlier:
Panoramic Representation of Scenes for Route Understanding,
ICPR90(I: 161-167).
IEEE DOI Use a 360 degree (cylindrical) view of the scene. Mostly a matching of scan lines with order preserving match as in stereo of the camera view and the panoramic view. BibRef

Zheng, J.Y.[Jiang Yu], Shi, M.[Min],
Scanning Depth of Route Panorama Based on Stationary Blur,
IJCV(78), No. 2-3, July 2008, pp. 169-186.
Springer DOI 0803
BibRef
Earlier: A2, A1:
A Slit Scanning Depth of Route Panorama from Stationary Blur,
CVPR05(I: 1047-1054).
IEEE DOI 0507
BibRef
And: A1, A2:
Depth from Stationary Blur with Adaptive Filtering,
ACCV07(II: 42-52).
Springer DOI 0711
BibRef
Earlier: A1, A2:
Removing Temporal Stationary Blur in Route Panoramas,
ICPR06(III: 709-713).
IEEE DOI 0609
Slit view, tilted slightly up. Blur into depth. BibRef

Zheng, J.Y., Asada, M., Tsuji, S.,
Color-Based Panoramic Representation of Outdoor Environment for a Mobile Robot,
ICPR88(II: 801-803).
IEEE DOI BibRef 8800

Ishiguro, H., Maeda, T., Miyashita, T., Tsuji, S.,
Building Environmental-Models of Man-Made Environments by Panoramic Sensing,
AdvRob(9), No. 4, 1995, pp. 399-416. BibRef 9500

Yagi, Y., Nishizawa, Y., Yachida, M.,
Map-Based Navigation for a Mobile Robot with Omnidirectional Image Sensor COPIS,
RA(11), No. 5, October 1995, pp. 634-648. See also Real-Time Omnidirectional Image Sensor (COPIS) for Vision-Guided Navigation. BibRef 9510

Yagi, Y.S.[Yasu-Shi], Nishi, W.[Wataru], Benson, N.[Nels], Yachida, M.[Masahiko],
Rolling and swaying motion estimation for a mobile robot by using omnidirectional optical flows,
MVA(14), No. 2, June 2003, pp. 112-120.
Springer DOI 0307
BibRef

Yagi, Y.S.[Yasu-Shi], Nishi, W.[Wataru], Yamazawa, K., Yachida, M.[Masahiko],
Rolling Motion Estimation for Mobile Robot by Using Omnidirectional Image Sensor Hyperomnivision,
ICPR96(I: 946-950).
IEEE DOI 9608
(Osaka Univ., J) BibRef

Chahl, J.S., Srinivasan, M.V.,
Range Estimation with a Panoramic Visual Sensor,
JOSA-A(14), No. 9, September 1997, pp. 2144-2151. 9709
BibRef

Kang, S.B.[Sing Bing], Szeliski, R.S.[Richard S.],
3-D Scene Data Recovery Using Omnidirectional Multibaseline Stereo,
IJCV(25), No. 2, November 1997, pp. 167-183.
DOI Link 9712
BibRef
Earlier: CVPR96(364-370).
IEEE DOI BibRef
And: DEC-CRL-95-6, October, 1995.
HTML Version. BibRef

Kang, S.B.[Sing Bing], Szeliski, R.S.[Richard S.],
3D Environment Modeling from Multiple Cylindrical Panoramic Images,
PV01(329-358). 0107
To generate texture mapped models for virtual reality. BibRef

Shum, H.Y.[Heung-Yeung], Szeliski, R.S.[Richard S.],
Construction of Panoramic Image Mosaics with Global and Local Alignment,
PV01(227-268). 0107
BibRef
And:
Systems and Experiment Paper: Construction of Panoramic Image Mosaics with Global and Local Alignment,
IJCV(36), No. 2, February 2000, pp. 101-130.
DOI Link 0004
BibRef
And: Correction: IJCV(48), No. 2, July 2002, pp. 151-152.
DOI Link BibRef
Earlier:
Construction and Refinement of Panoramic Mosaics with Global and Local Alignment,
ICCV98(953-956).
IEEE DOI BibRef

Shum, H.Y.[Heung-Yeung], Szeliski, R.S.[Richard S.],
Panoramic Image Mosaics,
MicrosoftMSR-TR-97-23, September 1997
PDF File. BibRef 9709

Shum, H.Y.[Heung-Yeung], Han, M.[Mei], Szeliski, R.S.[Richard S.],
Interactive Construction of 3D Models from Panoramic Mosaics,
CVPR98(427-433).
IEEE DOI Get camera pose, then 3D. Factorization approach. BibRef 9800

Li, Y.[Yin], Tang, C.K.[Chi-Keung], Shum, H.Y.[Heung-Yeung],
Efficient Dense Depth Estimation from Dense Multiperspective Panoramas,
ICCV01(I: 119-126).
IEEE DOI 0106
A dense sequence of data. BibRef

Benosman, R., Maniere, T., Devars, J.,
Panoramic Sensor Calibration,
PRL(19), No. 5-6, April 1998, pp. 483-490. 9808
BibRef

Smadja, L., Benosman, R., Devars, J.,
Hybrid Stereo Configurations Through a Cylindrical Sensor Calibration,
MVA(17), No. 4, September 2006, pp. 251-264.
Springer DOI 0608
BibRef

Benosman, R., Devars, J.,
Panoramic Stereovision Sensor,
PV01(161-168). 0107
BibRef
Earlier: ICPR98(Vol I: 767-769).
IEEE DOI 9808
From the rotating linear CCD to pair of rotating cameras. BibRef

Benosman, R., Devars, J.,
Calibration of the Stereovision Panoramic Sensor,
PV01(169-180). 0107
Calibration of 2 linear CCD sensors. BibRef

Benosman, R., Maniere, T., Devars, J.,
Multidirectional Stereovision Sensor, Calibration and Scenes Reconstruction,
ICPR96(I: 161-165).
IEEE DOI 9608
(Univ. Pierre et Marie Curie, F) BibRef

Benosman, R., Devars, J.,
Matching Linear Stereoscopic Images,
PV01(181-199). 0107
3D reconstructions from stereo. Matching regions in the 2 views. BibRef

Huang, H.C.[Ho-Chao], Hung, Y.P.[Yi-Ping],
Panoramic Stereo Imaging System with Automatic Disparity Warping and Seaming,
GMIP(60), No. 3, May 1998, pp. 196-208. BibRef 9805

Basu, A.[Anup], Sahabi, H.[Hossein],
A Real-Time Panoramic Stereo Imaging System and Its Applications,
PV01(121-141). Double lobed mirror to give 2 images in one camera. BibRef 0100

Baldwin, J.[Jonathan], Basu, A.[Anup],
3d Estimation Using Panoramic Stereo,
ICPR00(Vol I: 97-100).
IEEE DOI 0009
BibRef

Peleg, S.[Shmuel], Ben-Ezra, M.[Moshe], Pritch, Y.[Yael],
Omnistereo: Panoramic Stereo Imaging,
PAMI(23), No. 3, March 2001, pp. 279-290.
IEEE DOI 0103
From a pair of panoramic images, left and right views. Cannot be done by a pair of panoramic camers, but from a mosaic with stereo cameras, or mosaics from a single camera. BibRef

Pritch, Y., Ben-Ezra, M.[Moshe], Peleg, S.[Shmuel],
Automatic Disparity Control in Stereo Panoramas (OmniStereo),
OMNIVIS00(xx-yy). 0012
BibRef
Earlier:
Optics for OmniStereo Imaging,
FIU01(447-467). BibRef

Peleg, S.[Shmuel], Pritch, Y.[Yael], Ben-Ezra, M.[Moshe],
Cameras for Stereo Panoramic Imaging,
CVPR00(I: 208-214).
IEEE DOI 0005
You can do it with longer runs! BibRef

Peleg, S.[Shmuel], Ben-Ezra, M.[Moshe], Pritch, Y.[Yael],
Panoramic Imaging with Horizontal Stereo,
PV01(143-160). Two systems, one with lenses, one with mirrors to capture 2 panoramic video rate images. Rotating camers (slits) and spiral mirror. BibRef 0100

Peleg, S.[Shmuel], Ben-Ezra, M.[Moshe],
Stereo Panorama with a Single Camera,
CVPR99(I: 395-401).
IEEE DOI
PDF File. Generated a panorama strip for Red/Green glasses. Impressive output. BibRef 9900

Nayar, S.K.[Shree K.], Karmarkar, A.[Amruta],
360 x 360 Mosaics: Regular and Stereoscopic,
PV01(291-307). 0107
Mosaics around the sphere. BibRef

Nayar, S.K.[Shree K.], Karmarkar, A.[Amruta],
360 x 360 Mosaics,
CVPR00(II: 388-395).
IEEE DOI 0005
Mosaic BibRef

Svoboda, T.[Tomás], Pajdla, T.[Tomás],
Epipolar Geometry for Central Catadioptric Cameras,
IJCV(49), No. 1, August 2002, pp. 23-37.
DOI Link 0209
BibRef

Svoboda, T.[Tomás], Pajdla, T.[Tomás],
Matching in Catadioptric Images with Appropriate Windows, and Outliers Removal,
CAIP01(733 ff.).
Springer DOI 0210
BibRef

Pajdla, T.[Tomas], Svoboda, T.[Tomas], Hlavác, V.[Vaclav],
Epipolar Geometry for Central Panoramic Catadioptric Cameras,
PV01(73-102). 0107
Details of the projections. BibRef

Svoboda, T.[Tomas], Pajdla, T., Hlavác, V.,
Epipolar Geometry for Panoramic Cameras,
ECCV98(I: 218).
Springer DOI Epipolar. Hyperbolic mirror. Uses stereo.
HTML Version. And:
PS File. BibRef 9800

Menem, M., Pajdla, T.,
Constraints on perspective images and circular panoramas,
BMVC04(xx-yy).
HTML Version. 0508
BibRef

Peer, P.[Peter], Solina, F.[Franc],
Panoramic Depth Imaging: Single Standard Camera Approach,
IJCV(47), No. 1-3, April-June 2002, pp. 149-160.
DOI Link 0203
BibRef
Earlier:
Mosaic-Based Panoramic Depth Imaging with a Single Standard Camera,
SMBV01(xx-yy). 0110
BibRef

Seitz, S.M.[Steven M.], Kalai, A.[Adam], Shum, H.Y.[Heung-Yeung],
Omnivergent Stereo,
IJCV(48), No. 3, July-August 2002, pp. 159-172.
DOI Link 0207
BibRef
Earlier: A3, A2, A1: ICCV99(22-29).
IEEE DOI Spherical, center strip, dual strip cameras. Collect a small number of rays at many viewpoints. Horizontal epi-polar lines. For any point, a maximal vergence pair is found. BibRef

Li, Y.[Yin], Shum, H.Y.[Heung-Yeung], Tang, C.K.[Chi-Keung], Szeliski, R.S.[Richard S.],
Stereo Reconstruction from Multiperspective Panoramas,
PAMI(26), No. 1, January 2004, pp. 45-62.
IEEE Abstract. 0401
BibRef
Earlier: A2, A4 only: ICCV99(14-21).
IEEE DOI Use large number of images from constrained motion camera. BibRef

Zhu, Z.G.[Zhi-Gang], Hanson, A.R.[Allen R.],
LAMP: 3D layered, adaptive-resolution, and multi-perspective panorama: A new scene representation,
CVIU(96), No. 3, December 2004, pp. 294-326.
Elsevier DOI 0411
BibRef
Earlier:
3D LAMP: A New Layered Panoramic Representation,
ICCV01(II: 723-730).
IEEE DOI 0106
3-D representations with mosaics. See also Generalized parallel-perspective stereo mosaics from airborne video. BibRef

Zhu, Z.,
3D LAMP: Layered Representation for Image-based Rendering,
Online Book2004.
HTML Version.
WWW Link. BibRef 0400

Lee, Y.J.[Young Jin], Kim, D.Y.[Do-Yoon], Chung, M.J.[Myung Jin],
Feature matching in omnidirectional images with a large sensor motion for map generation of a mobile robot,
PRL(25), No. 4, March 2004, pp. 413-427.
Elsevier DOI 0402
BibRef

Ishiguro, H.[Hiroshi], Sogo, T.[Takushi], Barth, M.[Matthew],
Baseline Detection and Localization for Invisible Omnidirectional Cameras,
IJCV(58), No. 3, July-August 2004, pp. 209-226.
DOI Link 0404
BibRef

Fiala, M.[Mark], Basu, A.[Anup],
Panoramic stereo reconstruction using non-SVP optics,
CVIU(98), No. 3, June 2005, pp. 363-397.
Elsevier DOI 0505
BibRef
Earlier: ICPR02(IV: 27-30).
IEEE DOI 0211
See also Robot Navigation Using Panoramic Tracking. BibRef

Fiala, M.[Mark],
Immersive Panoramic Imagery,
CRV05(386-391).
IEEE DOI 0505
BibRef

Fiala, M.[Mark],
Structure from Motion using SIFT Features and the PH Transform with Panoramic Imagery,
CRV05(506-513).
IEEE DOI 0505
BibRef

Fiala, M., Basu, A.,
Feature extraction and calibration for stereo reconstruction using non-SVP optics in a panoramic stereo-vision sensor,
OMNIVIS02(79-86).
IEEE Abstract. 0310
BibRef

Sato, T.[Tomokazu], Yokoya, N.[Naokazu],
Efficient hundreds-baseline stereo by counting interest points for moving omni-directional multi-camera system,
JVCIR(21), No. 5-6, July-August 2010, pp. 416-426.
Elsevier DOI 1007
BibRef
Earlier:
New Multi-baseline Stereo by Counting Interest Points,
CRV05(96-103).
IEEE DOI 0505
Multi-baseline stereo; Depth estimation; Interest point; Omni-directional camera system; Multi-camera system; Efficient algorithm; Spatial consistency; TNIP-based stereo BibRef

Tang, Y.P.[Yi-Ping], Wang, Q.[Qing], Zong, M.L.[Ming-Li], Jiang, J.[Jun], Zhu, Y.H.[Yi-Hua],
Design of Vertically Aligned Binocular Omnistereo Vision Sensor,
JIVP(2010), No. 2010, pp. xx-yy.
DOI Link 1101
BibRef

Arican, Z.[Zafer], Frossard, P.[Pascal],
Joint Registration and Super-Resolution With Omnidirectional Images,
IP(20), No. 11, November 2011, pp. 3151-3162.
IEEE DOI 1110
BibRef
Earlier:
Sampling-aware polar descriptors on the sphere,
ICIP10(3509-3512).
IEEE DOI 1009
BibRef
Earlier:
Super-resolution from unregistered omnidirectional images,
ICPR08(1-4).
IEEE DOI 0812
BibRef
And:
Dense disparity estimation from omnidirectional images,
AVSBS07(399-404).
IEEE DOI 0709
BibRef

Arican, Z.[Zafer], Frossard, P.[Pascal],
Scale-Invariant Features and Polar Descriptors in Omnidirectional Imaging,
IP(21), No. 5, May 2012, pp. 2412-2423.
IEEE DOI 1204
BibRef
Earlier:
OmniSIFT: Scale invariant features in omnidirectional images,
ICIP10(3505-3508).
IEEE DOI 1009
BibRef

Monteiro, N.B.[Nuno Barroso], Marto, S.[Simao], Barreto, J.P.[Joao Pedro], Gaspar, J.[Jose],
Depth range accuracy for plenoptic cameras,
CVIU(168), 2018, pp. 104-117.
Elsevier DOI 1804
Standard plenoptic camera, Projection, Reconstruction, Depth range BibRef

Hahne, C.[Christopher], Aggoun, A.[Amar], Velisavljevic, V.[Vladan], Fiebig, S.[Susanne], Pesch, M.[Matthias],
Baseline and Triangulation Geometry in a Standard Plenoptic Camera,
IJCV(126), No. 1, January 2018, pp. 21-35.
Springer DOI 1801
Light field triangulation. Microlenses. BibRef

Hahne, C.[Christopher], Aggoun, A.[Amar], Velisavljevic, V.[Vladan],
The refocusing distance of a standard plenoptic photograph,
3DTV-CON15(1-4)
IEEE DOI 1508
Cameras BibRef

Hahne, C.[Christopher], Aggoun, A.[Amar], Haxha, S., Velisavljevic, V.[Vladan], Fernandez, J.C.J.,
Baseline of virtual cameras acquired by a standard plenoptic camera setup,
3DTV-CON14(1-3)
IEEE DOI 1409
approximation theory BibRef

Pan, J.[Janice], Mueller, M.[Martin], Lahlou, T.[Tarek], Bovik, A.C.[Alan C.],
Orthogonally-Divergent Fisheye Stereo,
ACIVS18(112-124).
Springer DOI 1810
BibRef

Yang, Y., Jin, S., Liu, R., Kang, S.B., Yu, J.,
Automatic 3D Indoor Scene Modeling from Single Panorama,
CVPR18(3926-3934)
IEEE DOI 1812
Layout, Object detection, Semantics, Image segmentation, Shape, Estimation BibRef

Song, S., Zeng, A., Chang, A.X., Savva, M., Savarese, S., Funkhouser, T.,
Im2Pano3D: Extrapolating 360° Structure and Semantics Beyond the Field of View,
CVPR18(3847-3856)
IEEE DOI 1812
Semantics, Extrapolation, Task analysis, Cameras, Mathematical model, Encoding BibRef

Tang, M., Wen, J., Zhang, Y., Gu, J., Junker, P., Guo, B., Jhao, G., Zhu, Z., Han, Y.,
A Universal Optical Flow Based Real-Time Low-Latency Omnidirectional Stereo Video System,
MultMed(21), No. 4, April 2019, pp. 957-972.
IEEE DOI 1903
Optical imaging, Adaptive optics, Streaming media, Cameras, Real-time systems, Optical buffering, Internet, video stitch BibRef

Won, C., Ryu, J., Lim, J.,
OmniMVS: End-to-End Learning for Omnidirectional Stereo Matching,
ICCV19(8986-8995)
IEEE DOI 2004
calibration, cameras, decoding, estimation theory, feature extraction, image coding, image matching, Computational modeling BibRef

Perfetti, L., Fassi, F., Rossi, C.,
Fisheye Photogrammetry to Generate Low-cost DTMS,
LC3D19(257-263).
DOI Link 1912
BibRef