Unreal Engine 4 FishEye Plug-In

There is an increasing demand for 3DCG images for machine learning, and verification in the field of Computer Vision (CV), and R&D.
However, it is not easy to produce photo-realistic images which are equal to physical cameras by utilizing traditional CVimaging tools. In particular, generating super-wide angled images, such as FishEye cameras do in real time, prove challenging.
In many cases depth and labeling of images are necessary for machine learning. Special rendering settings are required to produce these images, which are different from the ones used for photo-realistic image generation.

This Plug-In helps you to simulate FishEye cameras and super-wide angle cameras in Unreal Engine 4 (UE4). Robots, surveillance cameras and automobiles implement wide viewing angles and special lens profiles. Our Plug-in would be best suited as a learning or verification tool for these R&D laboratories, but can also be applied to a variety of other developments.
UE4 does not support features for displaying FishEye images and any super-wide angled images over 180 degree by default.*
Implementing our Plug-In enables you to express camera views based on a variety of lens profiles from equidistant projection to equisolid angle projection.

* As of March 2021, according to a study by Silicon Studio

Unreal Engine 4 FishEye Plug-In
Unreal Engine 4 FishEye Plug-In
Unreal Engine 4 FishEye Plug-In
Unreal Engine 4 FishEye Plug-In

Major characteristics of FishEye Plug-In

Our GPU process produces realistic FishEye camera views, which are not implemented in UE4 by default (It has been confirmed that 2K video can be played at 20+ fps with NVIDIA’s GeForce RTX 2080 Ti).
Driving simulators for automated driving and/or self-parking require FishEye camera views in real-time, and we can also contribute in this field. Real-time preview is available for special camera views as well, which can lead to shortened development periods.

• The same camera can be used to display depth or labeling images for your R&D work.
• Super-wide angle camera views can be reproduced to represent various types of FishEye cameras and unique distortion patterns.
• High-speed processing, optimal for outputting labeling images.

Major characteristics of FishEye Plug-In
Major characteristics of FishEye Plug-In
Major characteristics of FishEye Plug-In

Information

General Contact

Silicon Studio Corporation
1-21-3 Ebisu Shibuya-ku, Tokyo 150-0013

Research & Development Div.

TEL:+81-3-5488-7070
FAX:+81-3-5488-7433