Ticket #53 (closed enhancement: fixed)

Opened 16 months ago

Last modified 7 months ago

Performance comparison report

Reported by: fcohen Owned by: llara@…
Priority: critical Milestone:
Version: 5 Keywords: performance test results analysis
Cc:

Description

A utility that appears under the Tools drop down menu to compare results between test runs using logged results data. For instance, compare the test results of a test operated last week to the same test operated today to surface an improvement in performance.

Attachments

Performance_Comparison_spec.pdf (126.9 kB) - added by fcohen 16 months ago.
PerfCompare_GUI_2.pdf (115.2 kB) - added by fcohen 15 months ago.

Change History

Changed 16 months ago by fcohen

  • priority changed from major to minor

Changed 16 months ago by fcohen

Changed 16 months ago by fcohen

Received feedback from individual users. The design looks good. Please implement.

Changed 16 months ago by fcohen

  • priority changed from minor to major

Changed 15 months ago by fcohen

  • owner changed from wmartinez@… to llara@…

Changed 15 months ago by fcohen

  • owner changed from llara@… to llara@…

Luis Carlos proposes adding capability to compare TestNode operation.

From: llara@… Subject: Comparison Report Date: July 10, 2007 11:37:21 AM PDT To: frank@… Cc: wmartinez@…

Frank, I have updated the first functional utility for report comparison.

This system can compare any number of test scenarios done in different dates. Nevertheless it has a problem if you compare more than one test node.

One solution proposed by Willy is to enhance the architecture of the utility, adding the capacity to compare nodes, not only scenarios done.

This idea will allow the user to compare · A specific node in the test scenario done in different dates. · Different nodes in the same scenario. · A node in the scenario but with different CVS and Size · Summaries between nodes, not only TPS, but the number of transactions, the maximum and minimum time of responses, the average of usage of sum, net, and cpu. · Summaries between scenarios (Summary results), not only TPS, but the number of transactions, the maximum and minimum time of responses, the average of usage of sum, net, and cpu.

If you want I can start the developing the design of the comparison utility enhancement. Much of the code is done, but I will require a few hours in the drawing board to develop a high quality design.

Right now I am working in finishing the SNMP system.

Changed 15 months ago by fcohen

  • status changed from new to closed
  • resolution set to fixed

Works great. Excellent job!

Changed 15 months ago by fcohen

  • status changed from closed to reopened
  • resolution deleted

Changed 15 months ago by fcohen

Additional function to compare performance between TestNodes?. And enhanced graphic interface. See attached pdf for the new gui design.

Changed 15 months ago by fcohen

Changed 15 months ago by fcohen

  • priority changed from major to critical

Changed 15 months ago by fcohen

  • status changed from reopened to closed
  • resolution set to fixed

It works, it looks beautiful. After beta 3 I will be making a bunch of small changes to the UI elements to be more intuitive. I need to document its function. We're good to go for beta 3 so I'm closing this as fixed. -Frank

Changed 7 months ago by root

Milestone release deleted

Note: See TracTickets for help on using tickets.