Real-time status for running test.

Question

Hello,We have a test project with about 200 test items that takes several hours to complete. When the test is running we see the tested application being exercised but we don't know which of the tests is being executed or if a test has failed until the end of the execution. Is there a way to have some kind of "live" status so we know if a test already has failed and which test is currently executing?. Thank you,Patricio.

hlalumiere · Answer

For our scale of execution we found the included tools for distributed testing management somewhat inadequate. Here is a pic of our main management dashboard, that interfaces to a SQL database, and of our distributed client, that configures test parameters prior to running each test, fetches the next test according to priority, sorts out associated development tickets being fixed by the dev team, updates the test suite from out SVN repo, runs TC through COM and updates the database with results, restart VMs that are failing repeatedly, serves as a watchdog, etc... Our tests run continuously, 24/7, the database is updated with results in real time, we fix tests all day long, have the possibility to throw a particular test at the top of the heap to get results on demand, etc... We also have another tool that runs on a management VM that reverts and restarts offline VMs automagically. Since we have upwards of 45 VMs total, we manage CPU and memory usage through vSphere directly.Intentionally blurred for your viewing pleasure...

agabriel · Answer

Using TestComplete 9.10 I created a Userform with a status bar that is updated as the tests are performed.It is event driven, and posts the same messages that go into the log,&nbsp;to the the appropriate window (I only have 2 for now since I only care about errors). As well, I keep a running count of the events as temporary project suite variables. The entire thing is updated all at once using a single function to stick it all together.The tests running out of overall number of tests, is precalculated using a separate function and the status bar is just a reflection of that (#of test /100).The CPU and Memory meters are event driven as well which is good enough for now...9.20 apparently has some additional things to tap into that could make those a little nicer :)

syedsafvan · Answer

To know anything during the test run, I think you ll have to use TestComplete&nbsp;Indication&nbsp;and have all the data that &nbsp;you would like to see pushed into the&nbsp;indicator. Please have a look into the help topic "Using TestComplete Indicator"Thankyou

cjayesh · Answer

Or if&nbsp;you are sitting away from the testmachine, you could possibly call a routine at the end of every test to email a notifier to you about the progress, though in your case it means you will have 200 emails per test run.

alexeykolosov · Answer

Hi Patricio,I have added your request to our DB as a suggestion. Thank you for your post. In addition to Jayesh's and Ahmed's posts, you can work with TestComplete via COM (see the 'Working With TestComplete via COM' help topic), so you can create a utility that will obtain and show the name of the currently running test item.

Forum Discussion

Real-time status for running test.

Recent Discussions

Problem displaying Call Stack

On-premises Azure build agents running TestExecute with ID-based licensing

CSV value dropping leading zeros

Related Content

Checking API Status in TestComplete

Execution progress - in real time

Azure DevOps Pipelines - Running “Headless” Tests