Harnessing the Unreal Engine Automation Framework for Performance Measurement

Explore Dovetail Games' approach to automation within Unreal Engine for performance measurement and analysis in this 30-minute conference talk from UFO 2020. Dive into the studio's use of the Unreal Engine Automation Testing Framework to build, deploy, run, and analyze performance in its Fishing Sim World franchise. Learn about integration and maintenance of the framework, performance validation techniques, and methods for data aggregation and dashboard presentation. Discover insights on scalability and ongoing efforts to migrate to Gauntlet. Gain valuable knowledge on writing automation tests, coding simple tests, defining test structures, and generating HTML reports. Examine fixed location FPS overviews, test target FPS data, and FPS data popups. Ideal for programmers interested in automation testing, producers focused on stable delivery and studio efficiency, and QA professionals seeking to enhance their skills in performance measurement and analysis within the Unreal Engine environment.

Introduction
Writing Automation Tests
Simple Automation Test
Coding the Test
Test Definition
Subclass
Variables
Get Tests
Run Test
Run Game Binder
Copy Results
HTML Generation
Test Failures
Exit Commands
Demo
Fixed Location FPS Overview
Test Target FPS Overview
Test Target FPS Data
FPS Data Popup
Takeaways
What we are working on
Our current solution