SynthEyes Admiration: Insights from Matt Merkovich, VFX Supervisor
In the world of visual effects, 3D tracking and matchmoving are essential tasks that require precision, speed, and versatility. One tool that has been making waves in the industry is Boris FX SynthEyes, a professional software known for its AI-powered tracking features and advanced motion estimation.
Matthew Merkovich, a specialist in 3D tracking and matchmoving, discovered SynthEyes through Russ Andersson, the original author of SynthEyes. Over the years, he has come to rely on SynthEyes for supervised 2D tracking, 3D solving, building and aligning 3D geometry, and review.
The user interface of SynthEyes may appear unfamiliar at first, but it is actually quite simple. Its streamlined workflows are designed to accelerate and simplify 3D match-moving tasks, making it a favourite among visual effects artists.
One of the key features of SynthEyes is its ML Motion Estimation. This deep learning-based motion tracking mode calculates optical flow between frames, enabling tracking on surfaces with low texture such as smooth walls or vehicles, and performing well under heavy motion or fast camera moves where traditional tracking often fails.
The AI Tools for Automatic Solves enhance automated tracking accuracy and speed, reducing manual adjustments and solving time in challenging shots. The Mesh-to-Track Parenting feature allows fast and efficient object attachment by linking 3D meshes to tracked data, facilitating complex scene integration.
SynthEyes also provides consistent and platform-ready lens distortion data exports to fit seamlessly into various post-production pipelines, enhancing interoperability. Its robust handling of stray edges and difficult footage ensures reliable tracking, even in problem areas.
Matthew Merkovich has used SynthEyes on a variety of projects, including the challenging shot for the show Mr. Robot and the tracking heads for face replacements in shots for Into the Badlands, which were further complicated by night, rain, and lightning conditions.
Despite these challenges, SynthEyes has proven to be a versatile tool that goes beyond just 3D tracking. It is also used for roto, set surveys, and rendering out mattes. For Matthew Merkovich, SynthEyes is the best 3D tracking and matchmoving app available, and he considers it the best tool for 3D camera tracking.
In fact, he has been using SynthEyes for his 3D tracking and matchmove needs for a long time, and his favourite project he's ever worked on was Minority Report due to the talented VFX team he worked with and the enduring popularity of the movie.
SynthEyes is available for a free trial through the Boris FX Hub, giving visual effects artists the opportunity to experience its powerful capabilities firsthand. With its focus on AI-enhanced automation and pipeline compatibility, SynthEyes continues to evolve and improve over the past twenty years, making it an invaluable tool for the ever-changing landscape of visual effects.
[1] Source: Boris FX website and product documentation.
Gadgets like SynthEyes, a professional 3D tracking software, leverage technology to streamline 3D match-moving tasks, making them simpler for visual effects artists. The advanced ML Motion Estimation feature in SynthEyes, a technology-driven innovation, calculates optical flow between frames, enabling tracking on surfaces with low texture and performing well under heavy motion or fast camera moves.
