Jump to content



Photo
- - - - -

Automated Flipper Test table


  • Please log in to reply
24 replies to this topic

#1 gtxjoe

gtxjoe

    VPF Veteran

  • VIP
  • 5,151 posts

  • Flag: United States of America

  • Favorite Pinball: Medieval Madness, AbraCadabra



Contributor

Posted 21 February 2014 - 02:25 AM

With the recent discussion on Flipper accuracy yesterday, I created a flipper test table for VP

 

It has 2 tests currently.

1) Ball is released from top of guide lane.  Flipper is triggered automatically by triggers on the playfield in 5 different locations along the flipper

2) Ball is released at about the cradle location above the flipper

Report can be printed out for review and comparison

 

Desktop and Cab vpt attached

 

Here are results from my Pincab:

Each row represents a trigger location.  Number is how many times the ball entered that kicker location.  With FPS high, shots are accurate but there are some anomalies (vp921 test#1 row4).  With FPS low, shots are affected.  Run the table and the values will make more sense.  DX9 test does not display the textboxes, but the report can still be printed out.  Try first on a DX7 version of VP to see how it works

VP 9.2.1 rev921 avg fps:1200
Test#1:25,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#1:0,0,0,0,4,21,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#1:0,0,0,0,0,0,0,0,9,16,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#1:0,0,0,0,0,0,0,0,0,20,0,0,1,1,3,0,0,0,0,0,0,0,0
Test#1:0,0,0,0,0,0,0,0,0,0,2,23,0,0,0,0,0,0,0,0,0,0,0

Test#2:0,0,22,3,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#2:0,0,0,0,0,0,0,0,0,25,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#2:0,0,0,0,0,0,0,0,0,0,25,0,0,0,0,0,0,0,0,0,0,0,0
Test#2:0,0,0,0,0,0,0,0,0,0,0,25,0,0,0,0,0,0,0,0,0,0,0
Test#2:0,0,0,0,0,0,0,0,0,0,0,0,0,0,13,8,4,0,0,0,0,0,0

VP9_DX9_test4 avg fps:1200
#1:25,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#1:0,0,0,0,0,25,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#1:0,0,0,0,0,0,0,0,6,19,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#1:0,0,0,0,0,0,0,0,0,25,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#1:0,0,0,0,0,0,0,0,0,0,1,24,0,0,0,0,0,0,0,0,0,0,0

Test#2:0,0,10,15,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#2:0,0,0,0,0,0,0,0,0,25,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#2:0,0,0,0,0,0,0,0,0,0,25,0,0,0,0,0,0,0,0,0,0,0,0
Test#2:0,0,0,0,0,0,0,0,0,0,0,23,2,0,0,0,0,0,0,0,0,0,0
Test#2:0,0,0,0,0,0,0,0,0,0,0,0,0,0,9,12,4,0,0,0,0,0,0

Give it a try and post your results.  You can move the trigger locations around if you want to see if all angles are achievable

 

Next step if it makes sense to pursue:

-Add some light animation to see what it takes to degrade performance

- Kick the ball out at angles towards the flipper and trigger the flipper to meet the ball

- Add statistics like angle info, mean and std deviation 

 

Any suggestions welcome.  Feel free to mod.  I quickly create the scripts, so lots of duplication and very little optimization but it works :)

 

testpf(small).pngAttached File  FlipperTest.zip   825.61KB   20 downloads


Results from my slow laptop. Shots all over the place

VP 9.2.1 rev921 FPS: 100
Test#1:24,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#1:0,0,1,1,2,16,4,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#1:0,0,1,0,0,0,0,1,20,2,1,0,0,0,0,0,0,0,0,0,0,0,0
Test#1:0,0,0,0,0,0,0,0,3,2,6,11,1,2,0,0,0,0,0,0,0,0,0
Test#1:0,0,0,0,0,1,0,0,0,1,11,8,3,1,0,0,0,0,0,0,0,0,0

Test#2:0,0,7,4,12,2,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#2:0,0,0,0,1,0,0,3,10,11,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#2:0,0,0,0,0,0,0,0,1,11,4,6,3,0,0,0,0,0,0,0,0,0,0
Test#2:0,0,0,0,0,0,0,0,0,1,3,2,15,3,1,0,0,0,0,0,0,0,0
Test#2:0,0,0,0,0,0,0,0,0,0,0,0,0,2,4,13,5,1,0,0,0,0,0

When posting your results, copy it from the debug window and post it here.  Don't worry about formatting it nicely in notepad.  The debug output will show up formatted.


Edited by gtxjoe, 21 February 2014 - 02:28 AM.


#2 UltraPeepi

UltraPeepi

    Enthusiast

  • Platinum Supporter
  • 216 posts
  • Location:Redmond, WA

  • Flag: United States of America

  • Favorite Pinball: Mary Shelly's Frankenstein

Posted 21 February 2014 - 03:30 AM

:)

 

Looks familiar to me

http://www.vpforums....topic=25611&hl=

 

Well done.


ultradmd_splash.png


#3 gtxjoe

gtxjoe

    VPF Veteran

  • VIP
  • 5,151 posts

  • Flag: United States of America

  • Favorite Pinball: Medieval Madness, AbraCadabra



Contributor

Posted 21 February 2014 - 03:55 AM

Ahh, yes.  I remember watching the cool Unit3d pinball flipper test video when it was first posted.  Looking at that post now, I see it was based on your FP table  :otvclap:    

 

I am tempted to put the automatic flipper controls onto a real table and see how well it would do :)



#4 Bob5453

Bob5453

    I'm taking a nap

  • VIP
  • 3,896 posts
  • Location:Near Dayton, Ohio USA

  • Flag: United States of America

  • Favorite Pinball: Any table I can play while sitting in a rocking chair




  • Trophies:

Posted 21 February 2014 - 05:05 AM

Ahh, yes.  I remember watching the cool Unit3d pinball flipper test video when it was first posted.  Looking at that post now, I see it was based on your FP table  :otvclap:    

 

I am tempted to put the automatic flipper controls onto a real table and see how well it would do :)

Try my Daffy Duck table and press A. This will make the table play itself, it works so good I bet it can beat your high Score eventually. I use to do this to test tables, just let them run.


Posted Image

You have discovered an Easter egg. Pat yourself on the back.


#5 toxie

toxie

    VPF Veteran

  • VP Dev Team
  • PipPipPipPipPipPip
  • 5,734 posts
  • Location:berlin, germany

  • Flag: Germany

  • Favorite Pinball: AFM

Posted 21 February 2014 - 07:36 AM

Great, that table should help improving this strange issue!



#6 mukuste

mukuste

    Pinball Fan

  • VP Dev Team
  • PipPipPipPip
  • 854 posts

  • Flag: ---------

  • Favorite Pinball: Centaur

Posted 21 February 2014 - 07:38 AM

Fantastic! I love that someone is applying the scientific method to pinball simulation! :otvclap:

 

These are the results from the current DX9 version (a bit ahead of Test4) on my laptop (Win7, GT 540M).

Framerates are low because I have all debug options on while I'm developing.

FPS: 120-130
Test#1:25,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#1:0,0,0,1,16,4,3,1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#1:0,0,0,0,0,0,0,4,8,13,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#1:0,0,0,0,0,0,0,0,0,13,8,4,0,0,0,0,0,0,0,0,0,0,0
Test#1:0,0,0,0,0,0,0,0,2,2,11,9,0,1,0,0,0,0,0,0,0,0,0

Test#2:0,0,12,7,6,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#2:0,0,0,0,0,0,0,2,15,8,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#2:0,0,0,0,0,0,0,0,0,9,8,8,0,0,0,0,0,0,0,0,0,0,0
Test#2:0,0,0,0,0,0,0,0,0,0,14,3,8,0,0,0,0,0,0,0,0,0,0
Test#2:0,0,0,0,0,0,0,0,0,0,0,0,4,7,7,7,0,0,0,0,0,0,0

Quite erratic, isn't it? I have to find out if script events are processed every physics cycle or if there is some lag there to exclude that as a source of variation. After that, I will definitely use this test as a starting point when I get into the physics code to see how consistent I can get it.



#7 mukuste

mukuste

    Pinball Fan

  • VP Dev Team
  • PipPipPipPip
  • 854 posts

  • Flag: ---------

  • Favorite Pinball: Centaur

Posted 21 February 2014 - 08:03 AM

I made a small change to the physics code, forcing it to always run at a fixed timestep instead of trying to make shorter increments towards the end of a frame.

FPS: ~130, with modded physics code
Test#1:25,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#1:0,0,0,0,0,25,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#1:0,0,0,0,0,0,0,0,17,8,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#1:0,0,0,0,0,0,0,0,0,25,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#1:0,0,0,0,0,0,0,0,0,0,11,14,0,0,0,0,0,0,0,0,0,0,0

Test#2:0,0,13,12,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#2:0,0,0,0,0,0,0,0,0,25,0,0,0,0,0,0,0,0,0,0,0,0,0
Test#2:0,0,0,0,0,0,0,0,0,0,25,0,0,0,0,0,0,0,0,0,0,0,0
Test#2:0,0,0,0,0,0,0,0,0,0,0,25,0,0,0,0,0,0,0,0,0,0,0
Test#2:0,0,0,0,0,0,0,0,0,0,0,12,13,0,0,0,0,0,0,0,0,0,0

Much better! I wonder where the remaining variation comes from.



#8 toxie

toxie

    VPF Veteran

  • VP Dev Team
  • PipPipPipPipPipPip
  • 5,734 posts
  • Location:berlin, germany

  • Flag: Germany

  • Favorite Pinball: AFM

Posted 21 February 2014 - 08:34 AM

my suspicion is still numerical precision, and that due to this different heuristics are triggered in the code. but that's just speculation.



#9 gtxjoe

gtxjoe

    VPF Veteran

  • VIP
  • 5,151 posts

  • Flag: United States of America

  • Favorite Pinball: Medieval Madness, AbraCadabra



Contributor

Posted 21 February 2014 - 01:36 PM

The kicker holes cover about 4 degrees each so if the shot is between the two kickers, you will see it bin in both adjacent kickers. So it may not be flipper variance but rather the kicker is not in the right spot ;)

Could probably calculate the ball angle when it hits a kicker and plot that data

#10 mukuste

mukuste

    Pinball Fan

  • VP Dev Team
  • PipPipPipPip
  • 854 posts

  • Flag: ---------

  • Favorite Pinball: Centaur

Posted 21 February 2014 - 03:06 PM

The kicker holes cover about 4 degrees each so if the shot is between the two kickers, you will see it bin in both adjacent kickers. So it may not be flipper variance but rather the kicker is not in the right spot ;)

Could probably calculate the ball angle when it hits a kicker and plot that data

 

But then they shouldn't sum up to 25, right? But they always do.



#11 gtxjoe

gtxjoe

    VPF Veteran

  • VIP
  • 5,151 posts

  • Flag: United States of America

  • Favorite Pinball: Medieval Madness, AbraCadabra



Contributor

Posted 21 February 2014 - 08:47 PM

I meant if the ball trajectory is between 2 kickers, the ball total will be split between those two kickers. No double hits

#12 mukuste

mukuste

    Pinball Fan

  • VP Dev Team
  • PipPipPipPip
  • 854 posts

  • Flag: ---------

  • Favorite Pinball: Centaur

Posted 21 February 2014 - 09:25 PM

Ah, ok, I see what you meant now. My hope was that the simulation would be stable enough to produce the exact same shot into the same kicker 25 out of 25 times. With my little physics mod that's still not quite true; it might be down to floating point accuracy, as toxie suggested, or there may be something else going on. In either case the variation seems low enough to be happy with I guess. Probably I should repeat the experiment and see if I get the exact same result.



#13 koadic

koadic

    Pinball Fan

  • VIP
  • 1,363 posts
  • Location:Omaha, NE, USA

  • Flag: United States of America

  • Favorite Pinball: Addams Family/Fish Tales/Medieval Madness



Contributor

Posted 21 February 2014 - 09:38 PM

Here is a variation of the test table which will report 2 different angles... the ball's angle of velocity when hitting the outside trigger, and the angle on the protractor that is hit. I copied the kickers and the flipper triggers from the original table, but I used a trigger instead of a bunch of kickers to increment the test and redid the scripting to use about 100 lines. Also, it only has two boxes for data display instead of the 125, but will report min/max/average of each triggers test as well as the angle reading for each ball.

Also, only a desktop version is available, but the backdrop settings can easily be altered if one wishes to use it on a cab.

Attached File  Flippertest2_desktop.zip   335.78KB   10 downloads

Example data dump (no fps taken though):

Ball Guide Lane Test 1
Ball Travel Angle: High = 35.75, Low = 33.68, Avg = 34.3012
Individual Results:
35.38,34.32,34.08,34.23,34.03,34.29,34.56,33.9,34.03,33.68,34.39,35.66,33.97,33.9,34.39,34.41,34.02,34.31,34.38,33.73,34.12,34.19,33.84,33.97,35.75

Protractor Angle: High = 24.06, Low = 23.37, Avg = 23.7292
Individual Results:
23.56,23.87,23.67,23.85,23.63,23.85,24.06,23.52,23.62,23.39,23.99,23.79,23.63,23.56,23.97,23.95,23.62,23.83,23.95,23.37,23.74,23.81,23.52,23.62,23.86


Ball Guide Lane Test 2
Ball Travel Angle: High = 54.86, Low = 54.18, Avg = 54.554
Individual Results:
54.64,54.23,54.62,54.56,54.78,54.22,54.22,54.78,54.45,54.71,54.29,54.81,54.4,54.53,54.39,54.75,54.52,54.86,54.69,54.63,54.81,54.61,54.72,54.45,54.18

Protractor Angle: High = 43.05, Low = 42.4, Avg = 42.738
Individual Results:
42.78,42.49,42.82,42.76,42.97,42.44,42.4,42.89,42.68,42.9,42.55,42.94,42.64,42.66,42.64,42.9,42.67,43.05,42.8,42.75,42.92,42.76,42.91,42.68,42.45


Ball Guide Lane Test 3
Ball Travel Angle: High = 69.82, Low = 69.02, Avg = 69.3708
Individual Results:
69.47,69.37,69.17,69.42,69.21,69.02,69.53,69.51,69.07,69.82,69.46,69.72,69.7,69.06,69.3,69.29,69.46,69.07,69.12,69.43,69.53,69.43,69.4,69.69,69.02

Protractor Angle: High = 58.87, Low = 58.06, Avg = 58.408
Individual Results:
58.44,58.44,58.2,58.43,58.31,58.06,58.52,58.61,58.11,58.87,58.43,58.75,58.7,58.16,58.38,58.37,58.53,58.17,58.12,58.43,58.53,58.51,58.37,58.69,58.07


Ball Guide Lane Test 4
Ball Travel Angle: High = 89, Low = 67.18, Avg = 69.4704
Individual Results:
67.99,67.87,67.65,67.85,67.86,89,68.31,67.54,67.75,67.92,67.37,88.87,67.65,68,67.54,68.23,68.07,67.3,68.2,67.95,67.57,67.99,67.64,67.18,67.46

Protractor Angle: High = 78.59, Low = 60.09, Avg = 62.0876
Individual Results:
60.87,60.73,60.56,60.73,60.73,78.59,61.12,60.37,60.66,60.8,60.29,78.49,60.54,60.89,60.4,61.05,60.95,60.25,61.02,60.79,60.49,60.86,60.52,60.09,60.4


Ball Guide Lane Test 5
Ball Travel Angle: High = 69.05, Low = 66.26, Avg = 67.7812
Individual Results:
68.96,67.51,67.87,68.54,69.05,67.75,68.12,66.26,67.35,68.35,68.27,67.89,66.77,68.11,68.06,67.11,67.74,68.27,68.03,68.56,67.5,68.74,66.66,66.36,66.7

Protractor Angle: High = 66.59, Low = 62.8, Avg = 65.326
Individual Results:
66.52,65.27,65.6,66.17,66.59,65.43,65.76,62.8,65.09,65.97,65.96,65.56,63.28,65.76,65.76,64.91,65.44,65.94,65.69,66.14,65.23,66.35,64.49,62.91,64.53


Ball Cradle Test 1
Ball Travel Angle: High = 45.67, Low = 44.7, Avg = 45.2808
Individual Results:
45.11,45.17,45.34,45.01,45.52,45.56,44.7,45.17,45.6,45.28,45.67,45.03,45.51,45.43,45.24,45.33,45.52,45.13,45.04,44.8,45.38,45.36,45.23,45.58,45.31

Protractor Angle: High = 32.96, Low = 32.24, Avg = 32.6324
Individual Results:
32.6,32.53,32.66,32.41,32.86,32.76,32.27,32.66,32.91,32.63,32.96,32.41,32.83,32.76,32.6,32.64,32.82,32.5,32.46,32.24,32.69,32.69,32.58,32.72,32.62


Ball Cradle Test 2
Ball Travel Angle: High = 74.11, Low = 72.91, Avg = 73.4156
Individual Results:
73.33,73.19,72.91,73.78,73.28,73.36,73.6,73.52,73.66,74.11,73.6,73.38,73.11,73.34,73.31,73.21,73.46,73.45,73.36,73.22,73.13,73.55,73.71,73.72,73.1

Protractor Angle: High = 60.49, Low = 59.35, Avg = 59.842
Individual Results:
59.76,59.64,59.35,60.18,59.71,59.79,59.98,59.94,60.07,60.49,60.02,59.82,59.56,59.79,59.76,59.62,59.87,59.88,59.8,59.67,59.57,60,60.11,60.13,59.54


Ball Cradle Test 3
Ball Travel Angle: High = 75.58, Low = 74.84, Avg = 75.2604
Individual Results:
75.29,75.29,75.57,75.33,74.98,74.84,75.18,75.51,74.87,75.29,74.88,75.42,75.47,75.21,75.02,75.53,75.32,75.18,75.58,75.22,75.28,75.29,75.14,75.42,75.4

Protractor Angle: High = 65.62, Low = 64.56, Avg = 64.9716
Individual Results:
64.99,64.98,65.23,65.03,64.69,64.56,64.88,65.17,64.6,64.99,64.63,65.07,65.15,64.92,64.76,65.18,65.03,64.87,65.62,64.94,64.96,65,64.86,65.1,65.08


Ball Cradle Test 4
Ball Travel Angle: High = 76.13, Low = 75.3, Avg = 75.7116
Individual Results:
75.61,75.84,75.76,75.84,75.66,75.41,75.3,75.79,75.81,75.72,75.49,76.11,75.56,76.06,75.36,75.93,75.44,75.69,75.53,75.71,76.01,75.66,75.63,76.13,75.74

Protractor Angle: High = 70.24, Low = 69.47, Avg = 69.8424
Individual Results:
69.75,69.97,69.86,69.96,69.78,69.57,69.47,69.9,69.93,69.86,69.63,70.2,69.7,70.17,69.53,70.05,69.6,69.83,69.68,69.84,70.11,69.8,69.77,70.24,69.86


Ball Cradle Test 5
Ball Travel Angle: High = 93.49, Low = 87.83, Avg = 89.172
Individual Results:
88.57,89.17,88.13,89.15,88.34,88.59,89.17,88.77,88.64,88.83,88.7,89,88.86,88.31,88.82,89.08,88.82,88.96,89,89.09,89.43,93.49,89.65,87.83,92.9

Protractor Angle: High = 89.85, Low = 85.39, Avg = 86.4596
Individual Results:
86,86.47,85.63,86.46,85.79,85.99,86.46,86.14,86.03,86.19,86.08,86.33,86.22,85.78,86.18,86.39,86.18,86.29,86.33,86.4,86.68,89.85,86.86,85.39,89.37


Edited by koadic, 21 February 2014 - 09:40 PM.


#14 mukuste

mukuste

    Pinball Fan

  • VP Dev Team
  • PipPipPipPip
  • 854 posts

  • Flag: ---------

  • Favorite Pinball: Centaur

Posted 21 February 2014 - 11:47 PM

Nice, koadic, that gives us even more data to play with.

 

Here are two full runs, once with vanilla physics and once with my mod. Again the results with the modded timestep are MUCH more consistent. Without mod, the Cradle 5 test was pretty catastrophic since one ball even failed to reach the triggers and went down the drain... I had to manually throw in a new one from the debug menu :D

FPS: ~120, latest DX9 version

Ball Guide Lane Test 1
Ball Travel Angle: High = 43,89, Low = 25, Avg = 33,6352
Individual Results:
    43,89,32,91,34,1,34,97,34,39,34,94,34,05,33,78,33,52,33,76,33,63,34,67,34,74,34,41,33,52,27,3,25,34,82,35,51,34,59,34,1,34,87,29,56,29,34,34,51
 
Protractor Angle: High = 30,85, Low = 14,03, Avg = 22,6216
Individual Results:
    30,85,21,27,22,76,23,57,23,63,23,78,23,46,23,24,23,1,23,26,23,32,23,97,23,78,23,46,23,08,16,55,14,03,24,04,24,62,23,31,22,83,24,05,18,26,18,01,23,31
 
 
Ball Guide Lane Test 2
Ball Travel Angle: High = 64,45, Low = 41,15, Avg = 55,2764
Individual Results:
    64,45,59,28,41,75,52,54,62,94,58,86,42,21,41,59,61,67,50,26,51,71,63,83,59,22,54,06,58,09,51,83,62,17,61,55,51,93,54,66,63,02,53,28,60,13,41,15,59,73
 
Protractor Angle: High = 51,15, Low = 30,16, Avg = 42,6468
Individual Results:
    51,15,46,27,30,48,40,19,49,38,45,66,31,48,30,16,48,21,37,27,38,69,50,43,46,01,42,23,44,95,38,87,48,78,48,11,40,38,42,24,49,69,41,73,46,77,30,63,46,41
 
 
Ball Guide Lane Test 3
Ball Travel Angle: High = 75,81, Low = 64,87, Avg = 67,49
Individual Results:
    66,3,64,87,66,48,65,71,65,27,75,81,66,48,65,79,65,99,71,79,67,8,66,73,72,19,66,44,65,52,73,28,66,51,66,49,65,51,66,97,65,39,66,45,66,64,70,78,66,06
 
Protractor Angle: High = 63,41, Low = 54,23, Avg = 56,5304
Individual Results:
    56,03,54,65,55,79,55,51,54,92,63,41,55,91,55,33,55,33,58,97,57,08,56,08,59,38,55,71,55,01,61,23,55,75,56,12,54,9,56,29,54,82,55,85,55,62,59,34,54,23
 
 
Ball Guide Lane Test 4
Ball Travel Angle: High = 77,71, Low = 62,39, Avg = 67,7568
Individual Results:
    74,92,74,99,64,79,72,89,63,01,73,03,63,49,73,33,62,66,66,51,64,14,62,92,63,78,72,97,62,39,63,07,73,6,63,42,71,61,62,58,63,63,77,71,74,61,62,51,65,36
 
Protractor Angle: High = 69,37, Low = 55,7, Avg = 60,674
Individual Results:
    66,74,66,78,58,14,64,98,57,22,64,85,57,29,65,29,57,59,07,57,51,55,98,57,25,64,98,55,7,56,23,65,55,56,83,64,59,56,86,57,04,69,37,66,53,56,91,58,16
 
 
Ball Guide Lane Test 5
Ball Travel Angle: High = 74,82, Low = 59,59, Avg = 64,9116
Individual Results:
    63,59,66,43,62,98,61,62,62,09,61,6,63,18,69,68,63,42,62,12,74,82,68,14,63,42,62,49,59,59,67,3,73,11,63,47,63,35,62,02,69,47,72,63,63,21,62,29,60,77
 
Protractor Angle: High = 70,18, Low = 57,95, Avg = 62,4108
Individual Results:
    61,52,63,68,61,1,58,6,60,26,58,75,61,44,65,87,61,67,60,62,70,18,65,78,61,26,60,95,58,86,64,57,68,86,61,62,61,27,60,84,65,73,68,47,59,79,60,63,57,95
 
 
Ball Cradle Test 1
Ball Travel Angle: High = 52,03, Low = 44,58, Avg = 46,3076
Individual Results:
    44,58,46,82,45,05,45,19,47,28,44,72,45,03,45,38,49,23,52,03,45,34,47,6,50,56,45,08,48,59,44,92,44,89,44,92,45,61,46,39,44,92,45,67,45,7,47,11,45,08
 
Protractor Angle: High = 38,31, Low = 32,85, Avg = 33,916
Individual Results:
    33,33,45,33,59,33,17,33,73,33,27,33,54,33,69,35,47,38,31,33,84,33,82,36,91,33,29,35,33,32,91,33,2,33,42,33,58,32,85,33,09,33,56,34,04,33,63,33,21
 
 
Ball Cradle Test 2
Ball Travel Angle: High = 73,82, Low = 61,42, Avg = 70,644
Individual Results:
    70,89,73,82,71,51,67,64,71,51,73,7,71,06,68,65,70,68,73,14,70,69,68,95,70,42,71,85,70,54,73,52,61,42,71,88,70,88,70,67,70,88,71,83,68,71,21,70,76
 
Protractor Angle: High = 59,99, Low = 49,59, Avg = 57,5316
Individual Results:
    57,97,59,99,58,58,54,97,58,63,59,9,58,18,55,28,57,83,59,26,57,85,55,65,57,57,58,37,57,59,59,52,49,59,59,02,57,81,57,41,57,91,58,82,54,66,58,04,57,89
 
 
Ball Cradle Test 3
Ball Travel Angle: High = 82,53, Low = 71, Avg = 74,636
Individual Results:
    72,07,71,88,71,41,81,41,71,97,81,2,71,05,71,11,72,07,81,22,81,56,73,06,72,09,71,69,72,5,76,09,82,53,71,71,53,72,05,78,21,71,15,71,97,81,56,73,52
 
Protractor Angle: High = 71,16, Low = 61,31, Avg = 64,5384
Individual Results:
    62,34,62,35,62,04,70,1,62,57,70,09,61,31,61,53,62,37,69,84,70,35,63,36,62,58,62,34,62,8,65,61,71,16,61,33,62,13,62,4,67,38,61,43,62,26,70,21,63,58
 
 
Ball Cradle Test 4
Ball Travel Angle: High = 83,19, Low = 70,79, Avg = 74,4548
Individual Results:
    83,11,74,65,72,80,17,72,33,71,73,72,22,72,27,71,67,74,29,71,29,71,93,71,74,77,06,77,6,70,79,71,73,72,42,71,77,71,01,83,07,79,78,71,69,83,19,71,86
 
Protractor Angle: High = 76,5, Low = 65,6, Avg = 68,8948
Individual Results:
    76,43,69,08,67,12,73,55,67,12,66,5,66,92,66,98,66,58,68,59,66,66,88,66,48,71,12,71,56,65,64,66,55,67,27,66,73,65,6,76,39,73,43,66,63,76,5,66,72
 
 
Ball Cradle Test 5
Ball Travel Angle: High = 95,76, Low = 0, Avg = 76,2092
Individual Results:
    75,75,84,08,88,48,86,58,90,01,83,64,90,08,0,83,67,92,7,74,07,65,13,94,14,95,76,71,34,58,84,88,4,71,52,53,46,89,29,73,05,76,63,63,21,92,07,63,33
 
Protractor Angle: High = 91,95, Low = -53,11, Avg = 75,5752
Individual Results:
    78,58,82,76,85,78,84,48,87,02,82,16,87,22,-53,11,82,58,89,32,76,36,72,95,90,72,91,95,74,56,71,23,85,67,74,98,70,06,86,44,75,99,77,73,72,28,88,8,72,87


----------------------------------------------------------------------------------------------------------------

FPS: ~120, with physics mod

Ball Guide Lane Test 1
Ball Travel Angle: High = 35,67, Low = 33,86, Avg = 34,286
Individual Results:
    34,36,34,31,35,67,34,49,34,49,34,08,34,36,35,53,34,03,33,95,34,37,34,04,34,35,33,9,33,87,34,07,33,86,34,34,47,34,15,33,89,34,28,34,36,34,14,34,13
 
Protractor Angle: High = 24,05, Low = 23,51, Avg = 23,7736
Individual Results:
    23,93,23,9,23,78,24,05,24,03,23,7,23,93,23,67,23,65,23,6,23,93,23,67,23,93,23,56,23,52,23,68,23,51,23,63,24,03,23,77,23,55,23,86,23,95,23,76,23,75
 
 
Ball Guide Lane Test 2
Ball Travel Angle: High = 54,89, Low = 54,15, Avg = 54,5308
Individual Results:
    54,33,54,43,54,21,54,28,54,67,54,65,54,58,54,72,54,75,54,38,54,89,54,15,54,48,54,65,54,84,54,87,54,26,54,47,54,82,54,42,54,19,54,22,54,7,54,53,54,78
 
Protractor Angle: High = 43,05, Low = 42,37, Avg = 42,7132
Individual Results:
    42,52,42,62,42,44,42,52,42,82,42,8,42,74,42,87,42,91,42,59,43,05,42,37,42,66,42,8,42,99,43,03,42,46,42,67,42,97,42,64,42,39,42,44,42,89,42,71,42,93
 
 
Ball Guide Lane Test 3
Ball Travel Angle: High = 69,73, Low = 68,87, Avg = 69,3056
Individual Results:
    69,41,69,58,69,41,69,67,69,36,68,96,68,87,69,14,68,99,68,88,69,58,69,51,69,39,69,63,69,2,69,73,68,99,68,88,69,14,69,39,69,41,69,35,69,22,69,67,69,28
 
Protractor Angle: High = 58,73, Low = 57,92, Avg = 58,3408
Individual Results:
    58,42,58,58,58,42,58,71,58,39,58,03,57,92,58,21,58,03,57,92,58,61,58,51,58,44,58,61,58,25,58,73,58,09,57,96,58,2,58,43,58,44,58,38,58,28,58,68,58,28
 
 
Ball Guide Lane Test 4
Ball Travel Angle: High = 68,14, Low = 67,35, Avg = 67,7392
Individual Results:
    67,8,67,74,67,94,67,66,67,73,68,02,67,75,67,95,67,85,67,52,68,14,67,59,67,76,67,69,67,89,67,51,67,66,67,97,67,45,67,35,67,89,67,57,67,54,67,56,67,95
 
Protractor Angle: High = 60,98, Low = 60,27, Avg = 60,62
Individual Results:
    60,69,60,61,60,79,60,56,60,61,60,86,60,64,60,8,60,71,60,41,60,98,60,5,60,66,60,56,60,76,60,44,60,55,60,82,60,35,60,27,60,76,60,47,60,42,60,46,60,82
 
 
Ball Guide Lane Test 5
Ball Travel Angle: High = 68,53, Low = 67,61, Avg = 68,0524
Individual Results:
    67,76,68,11,68,2,68,05,68,05,68,46,68,13,68,11,67,74,68,43,68,52,67,61,67,64,67,89,68,17,67,95,68,68,28,68,53,67,65,67,62,68,04,67,92,68,07,68,38
 
Protractor Angle: High = 66,16, Low = 65,35, Avg = 65,7372
Individual Results:
    65,48,65,78,65,87,65,74,65,73,66,08,65,81,65,8,65,46,66,07,66,16,65,35,65,36,65,61,65,83,65,65,65,68,65,96,66,16,65,37,65,35,65,73,65,62,65,75,66,03
 
 
Ball Cradle Test 1
Ball Travel Angle: High = 46,08, Low = 44,74, Avg = 45,578
Individual Results:
    45,56,45,9,45,89,45,77,45,95,46,04,46,08,45,7,45,94,45,58,45,66,45,57,45,57,44,74,44,85,46,07,45,6,45,58,45,57,45,24,45,7,45,8,45,55,44,75,44,79
 
Protractor Angle: High = 34,37, Low = 32,96, Avg = 33,816
Individual Results:
    33,71,34,34,21,34,1,34,26,34,34,34,37,33,83,34,11,33,94,33,8,33,72,33,93,32,96,33,06,34,36,33,95,33,8,33,71,33,4,33,83,34,13,33,91,32,97,33
 
 
Ball Cradle Test 2
Ball Travel Angle: High = 74,64, Low = 71,86, Avg = 73,5376
Individual Results:
    73,74,73,66,73,14,73,28,73,62,72,36,72,54,73,38,71,86,73,55,72,56,73,07,73,19,74,32,74,64,74,47,74,73,75,73,62,74,35,73,73,74,59,73,9,73,28,73,84
 
Protractor Angle: High = 61,24, Low = 58,26, Avg = 59,9852
Individual Results:
    60,17,60,07,59,51,59,73,60,05,58,74,58,9,59,82,58,26,59,96,58,92,59,44,59,64,60,92,61,24,61,02,60,41,60,16,60,1,60,93,60,17,61,16,60,3,59,77,60,24
 
 
Ball Cradle Test 3
Ball Travel Angle: High = 75,66, Low = 75,06, Avg = 75,3788
Individual Results:
    75,06,75,45,75,21,75,12,75,66,75,31,75,56,75,15,75,29,75,3,75,41,75,44,75,29,75,21,75,43,75,57,75,41,75,66,75,31,75,14,75,35,75,53,75,49,75,59,75,53
 
Protractor Angle: High = 65,54, Low = 64,97, Avg = 65,298
Individual Results:
    64,97,65,33,65,19,65,02,65,53,65,29,65,43,65,13,65,25,65,21,65,28,65,33,65,27,65,19,65,32,65,43,65,4,65,53,65,22,65,02,65,31,65,48,65,35,65,54,65,43
 
 
Ball Cradle Test 4
Ball Travel Angle: High = 75,98, Low = 75,15, Avg = 75,5224
Individual Results:
    75,35,75,73,75,83,75,46,75,45,75,72,75,31,75,74,75,38,75,16,75,24,75,64,75,28,75,78,75,98,75,37,75,38,75,68,75,9,75,4,75,45,75,8,75,15,75,15,75,73
 
Protractor Angle: High = 70,19, Low = 69,43, Avg = 69,772
Individual Results:
    69,63,69,96,70,04,69,72,69,71,69,96,69,57,69,98,69,64,69,43,69,51,69,87,69,56,70,70,19,69,63,69,64,69,91,70,12,69,67,69,71,70,01,69,43,69,44,69,97
 
 
Ball Cradle Test 5
Ball Travel Angle: High = 77,34, Low = 76,13, Avg = 76,718
Individual Results:
    77,02,76,13,76,37,76,49,76,55,76,63,76,87,76,76,76,54,76,35,77,11,77,03,76,6,76,82,76,63,77,04,77,13,77,09,76,31,77,34,76,72,76,65,76,97,76,28,76,52
 
Protractor Angle: High = 77,9, Low = 77,18, Avg = 77,5756
Individual Results:
    77,83,77,18,77,35,77,44,77,49,77,54,77,72,77,64,77,48,77,34,77,89,77,83,77,52,77,52,77,54,77,84,77,75,77,72,77,31,77,9,77,61,77,4,77,79,77,29,77,47



#15 gtxjoe

gtxjoe

    VPF Veteran

  • VIP
  • 5,151 posts

  • Flag: United States of America

  • Favorite Pinball: Medieval Madness, AbraCadabra



Contributor

Posted 22 February 2014 - 01:28 AM

Nice. Here is function for calculating Std Deviation.  I guess I won't be able to blame the VP flipper physics for my low scores anymore...

 

Function StdDev(sizeArr, Arr)
Dim i
Dim avg, SumSq
 
avg = Mean(sizeArr, Arr) 
For i = 1 To sizeArr 
SumSq = SumSq + (Arr(i) - avg) ^ 2 
Next
StdDev = Sqr(SumSq / (sizeArr - 1))
End Function 
 
Function Mean(sizeArr, Arr)
Dim Sum
Dim i
 
Sum = 0 
For i = 1 To sizeArr 
Sum = Sum + Arr(i) 
Next
Mean = Sum / sizeArr
End Function 

 

 



#16 mukuste

mukuste

    Pinball Fan

  • VP Dev Team
  • PipPipPipPip
  • 854 posts

  • Flag: ---------

  • Favorite Pinball: Centaur

Posted 22 February 2014 - 08:06 AM

Here's some more good news: I ran koadic's version a second time, again with the mod, and I got the same result. And by "same" I don't mean approximately, I mean the exact same numbers up to the fourth decimal digit.

 

So this proves that while there is a small amount of variance left, it doesn't depend on FPS anymore.



#17 mukuste

mukuste

    Pinball Fan

  • VP Dev Team
  • PipPipPipPip
  • 854 posts

  • Flag: ---------

  • Favorite Pinball: Centaur

Posted 04 March 2014 - 01:05 PM

I'll just dump my latest results here, mostly for my own reference. Physics now run at 400Hz, friction and scatter disabled.

 

This is pretty much the holy grail in reproducibility, almost no variance left.

Physics 400Hz; no PF, wall, or flipper friction; scatter disabled

Ball Guide Lane Test 1
Ball Travel Angle: High = 22,64, Low = 22,61, Avg = 22,6228
Individual Results:
    22,61,22,62,22,61,22,64,22,61,22,62,22,61,22,64,22,63,22,62,22,62,22,61,22,64,22,64,22,63,22,62,22,63,22,61,22,63,22,62,22,62,22,62,22,61,22,64,22,62
 
Protractor Angle: High = 13,71, Low = 13,68, Avg = 13,6956
Individual Results:
    13,69,13,7,13,68,13,71,13,68,13,69,13,69,13,71,13,7,13,7,13,69,13,69,13,71,13,71,13,7,13,69,13,7,13,68,13,7,13,7,13,69,13,69,13,68,13,71,13,7
 
 
Ball Guide Lane Test 2
Ball Travel Angle: High = 43,71, Low = 43,69, Avg = 43,6964
Individual Results:
    43,69,43,69,43,69,43,7,43,69,43,7,43,69,43,69,43,71,43,69,43,69,43,7,43,7,43,69,43,7,43,7,43,71,43,7,43,7,43,7,43,69,43,69,43,69,43,7,43,71
 
Protractor Angle: High = 32,6, Low = 32,58, Avg = 32,5892
Individual Results:
    32,59,32,58,32,59,32,6,32,58,32,6,32,58,32,58,32,6,32,58,32,58,32,59,32,59,32,58,32,59,32,6,32,6,32,6,32,59,32,59,32,58,32,59,32,58,32,59,32,6
 
 
Ball Guide Lane Test 3
Ball Travel Angle: High = 59,35, Low = 59,35, Avg = 59,35
Individual Results:
    59,35,59,35,59,35,59,35,59,35,59,35,59,35,59,35,59,35,59,35,59,35,59,35,59,35,59,35,59,35,59,35,59,35,59,35,59,35,59,35,59,35,59,35,59,35,59,35,59,35
 
Protractor Angle: High = 48,54, Low = 48,54, Avg = 48,54
Individual Results:
    48,54,48,54,48,54,48,54,48,54,48,54,48,54,48,54,48,54,48,54,48,54,48,54,48,54,48,54,48,54,48,54,48,54,48,54,48,54,48,54,48,54,48,54,48,54,48,54,48,54
 
 
Ball Guide Lane Test 4
Ball Travel Angle: High = 70,41, Low = 70,4, Avg = 70,4052
Individual Results:
    70,41,70,4,70,41,70,41,70,4,70,41,70,4,70,4,70,41,70,41,70,41,70,41,70,41,70,4,70,41,70,41,70,4,70,4,70,4,70,4,70,41,70,41,70,4,70,4,70,4
 
Protractor Angle: High = 61,82, Low = 61,81, Avg = 61,8152
Individual Results:
    61,82,61,81,61,82,61,82,61,81,61,82,61,81,61,81,61,82,61,82,61,82,61,82,61,82,61,81,61,82,61,82,61,81,61,81,61,81,61,81,61,82,61,82,61,81,61,81,61,81
 
 
Ball Guide Lane Test 5
Ball Travel Angle: High = 68,32, Low = 68,32, Avg = 68,32
Individual Results:
    68,32,68,32,68,32,68,32,68,32,68,32,68,32,68,32,68,32,68,32,68,32,68,32,68,32,68,32,68,32,68,32,68,32,68,32,68,32,68,32,68,32,68,32,68,32,68,32,68,32
 
Protractor Angle: High = 64,27, Low = 64,26, Avg = 64,2664
Individual Results:
    64,26,64,26,64,26,64,26,64,26,64,27,64,27,64,27,64,27,64,27,64,27,64,27,64,27,64,27,64,26,64,27,64,26,64,27,64,26,64,27,64,27,64,27,64,26,64,27,64,27
 
 
Ball Cradle Test 1
Ball Travel Angle: High = 45,51, Low = 45,51, Avg = 45,51
Individual Results:
    45,51,45,51,45,51,45,51,45,51,45,51,45,51,45,51,45,51,45,51,45,51,45,51,45,51,45,51,45,51,45,51,45,51,45,51,45,51,45,51,45,51,45,51,45,51,45,51,45,51
 
Protractor Angle: High = 32,67, Low = 32,67, Avg = 32,67
Individual Results:
    32,67,32,67,32,67,32,67,32,67,32,67,32,67,32,67,32,67,32,67,32,67,32,67,32,67,32,67,32,67,32,67,32,67,32,67,32,67,32,67,32,67,32,67,32,67,32,67,32,67
 
 
Ball Cradle Test 2
Ball Travel Angle: High = 62,51, Low = 62,51, Avg = 62,51
Individual Results:
    62,51,62,51,62,51,62,51,62,51,62,51,62,51,62,51,62,51,62,51,62,51,62,51,62,51,62,51,62,51,62,51,62,51,62,51,62,51,62,51,62,51,62,51,62,51,62,51,62,51
 
Protractor Angle: High = 49,96, Low = 49,96, Avg = 49,96
Individual Results:
    49,96,49,96,49,96,49,96,49,96,49,96,49,96,49,96,49,96,49,96,49,96,49,96,49,96,49,96,49,96,49,96,49,96,49,96,49,96,49,96,49,96,49,96,49,96,49,96,49,96
 
 
Ball Cradle Test 3
Ball Travel Angle: High = 75,33, Low = 75,33, Avg = 75,33
Individual Results:
    75,33,75,33,75,33,75,33,75,33,75,33,75,33,75,33,75,33,75,33,75,33,75,33,75,33,75,33,75,33,75,33,75,33,75,33,75,33,75,33,75,33,75,33,75,33,75,33,75,33
 
Protractor Angle: High = 64,47, Low = 64,47, Avg = 64,47
Individual Results:
    64,47,64,47,64,47,64,47,64,47,64,47,64,47,64,47,64,47,64,47,64,47,64,47,64,47,64,47,64,47,64,47,64,47,64,47,64,47,64,47,64,47,64,47,64,47,64,47,64,47
 
 
Ball Cradle Test 4
Ball Travel Angle: High = 76,08, Low = 76,08, Avg = 76,08
Individual Results:
    76,08,76,08,76,08,76,08,76,08,76,08,76,08,76,08,76,08,76,08,76,08,76,08,76,08,76,08,76,08,76,08,76,08,76,08,76,08,76,08,76,08,76,08,76,08,76,08,76,08
 
Protractor Angle: High = 69,73, Low = 69,73, Avg = 69,73
Individual Results:
    69,73,69,73,69,73,69,73,69,73,69,73,69,73,69,73,69,73,69,73,69,73,69,73,69,73,69,73,69,73,69,73,69,73,69,73,69,73,69,73,69,73,69,73,69,73,69,73,69,73
 
 
Ball Cradle Test 5
Ball Travel Angle: High = 78,06, Low = 78,06, Avg = 78,06
Individual Results:
    78,06,78,06,78,06,78,06,78,06,78,06,78,06,78,06,78,06,78,06,78,06,78,06,78,06,78,06,78,06,78,06,78,06,78,06,78,06,78,06,78,06,78,06,78,06,78,06,78,06
 
Protractor Angle: High = 77,49, Low = 77,49, Avg = 77,49
Individual Results:
    77,49,77,49,77,49,77,49,77,49,77,49,77,49,77,49,77,49,77,49,77,49,77,49,77,49,77,49,77,49,77,49,77,49,77,49,77,49,77,49,77,49,77,49,77,49,77,49,77,49


#18 faralos

faralos

    VPF Veteran

  • Members
  • PipPipPipPipPipPip
  • 7,838 posts
  • Location:Eastern Pa,USA

  • Flag: United States of America

  • Favorite Pinball: Flash (Williams) 1979, Flash2 Updated




  • Trophies:

Posted 04 March 2014 - 01:57 PM

egads sir rocket scientists whatever happened to starting a game then just playing it?

 seems that pin playing is going too scientific if you ask me


"Don’t let the noise of others’ opinions drown out your own inner voice.
And most important, have the courage to follow your heart and intuition.”
----Steve Jobs


#19 Slydog43

Slydog43

    Pinball Wizard

  • Platinum Supporter
  • 3,008 posts
  • Location:Hackettstown, NJ

  • Flag: United States of America

  • Favorite Pinball: Addams Family, All Williams 90's Games

Posted 04 March 2014 - 02:14 PM

wasn't the physics at 100hz before?  Have you made changes to the physics already in VP9.dx9 test?



#20 mukuste

mukuste

    Pinball Fan

  • VP Dev Team
  • PipPipPipPip
  • 854 posts

  • Flag: ---------

  • Favorite Pinball: Centaur

Posted 04 March 2014 - 02:28 PM

No, this is a private physics branch I started hacking on.