Really like your proposition idea and hope I can follow it somehow. If I can add anything I would suggest using frame time as your main metric instead of frames per second just because FPS is an inverse metric and can be really unintuitive to understand proportions. For example, an improvement from 20 FPS to 25 FPS looks like a 25% increase in performance when it's actually a 20% improvement in actual performance, which is measured by execution time or frame time. 20% is the real number because your frame time went from 50ms to 40ms. For FPS, this proportion varies depending on where you are: if have 100 FPS it's easier to gain +5 FPS (you need a 4.7% better frame time) compared to when you start from 20 FPS and want to gain the same +5 FPS (now you need 20% better frame time)
I believe that FPS should be considered as one of the main metrics, as it is what gamers and game developers use the most. However, your critique is completely valid and correct from a scientific point of view. I really liked your idea and will be including frame-time data on the final report of this project for the purposes of comparison and analysis. Thank you very much for your contribution! Is it fine if I give you a footnote in the final report? I'd like to credit the idea properly.
Really like your proposition idea and hope I can follow it somehow. If I can add anything I would suggest using frame time as your main metric instead of frames per second just because FPS is an inverse metric and can be really unintuitive to understand proportions. For example, an improvement from 20 FPS to 25 FPS looks like a 25% increase in performance when it's actually a 20% improvement in actual performance, which is measured by execution time or frame time. 20% is the real number because your frame time went from 50ms to 40ms.
For FPS, this proportion varies depending on where you are: if have 100 FPS it's easier to gain +5 FPS (you need a 4.7% better frame time) compared to when you start from 20 FPS and want to gain the same +5 FPS (now you need 20% better frame time)
I believe that FPS should be considered as one of the main metrics, as it is what gamers and game developers use the most.
However, your critique is completely valid and correct from a scientific point of view. I really liked your idea and will be including frame-time data on the final report of this project for the purposes of comparison and analysis.
Thank you very much for your contribution! Is it fine if I give you a footnote in the final report? I'd like to credit the idea properly.
@@Dwctor Damn, of course! That would be an honor! Agreed, I wouldn't abandon FPS as well. I'm hyped for your work, can't wait to see the results