Software for automatization of regression tests

Here you can discuss ReactOS related topics.

Moderator: Moderator Team

Post Reply
Vort
Posts: 12
Joined: Wed Nov 09, 2011 7:37 pm
Location: Ukraine

Software for automatization of regression tests

Post by Vort » Thu Nov 05, 2015 4:49 pm

Hello.

Ability to find the bug source without even touching the code is a great thing.
But to track down the guilty revision you need to perform hundreds of routine steps.

This was led me to thinking about automation of this process.
Findings was encouraging: everything in this task can be automated.

To start with, I have implemented the automation of this most annoying steps:
* Downloading and unpacking of zipped iso images.
* Enabling automatic (unattended) mode of setup.
* Injecting of test application into CD image.
* Creating and starting of virtual machine.

Results of this work are available at
https://github.com/Vort/RosRegTest

This software have some restrictions:
It requires .NET 4.5 and was tested only with Windows; you need to have VirtualBox installed.
To build it, you additionally need Visual Studio 2013.

Work process for this program is simple:
Select needed revision, provide the name for test program and press the button.
After a while, VirtualBox window with running ReactOS pops up.

Image

I offer you to test this software and share with your opinions about it.

(sorry for my bad English)

Swyter
Posts: 114
Joined: Sun Apr 10, 2011 11:21 am
Location: Spain ← Europe ← Planet Earth ← Milky Way ← Universe

Re: Software for automatization of regression tests

Post by Swyter » Thu Nov 05, 2015 8:50 pm

I also ended up putting together a similar batch script in 2012 that downloads daily builds, extracts and mounts them in VirtualBox, automatically starting the machine. But yours is way better, and the ability to slipstream third party software seals the deal. Great job!
External patch contributor for ux/user-mode/l10n/winapi. Sometimes I fix a bit of everything everywhere.

Vort
Posts: 12
Joined: Wed Nov 09, 2011 7:37 pm
Location: Ukraine

Re: Software for automatization of regression tests

Post by Vort » Thu Nov 12, 2015 11:16 am

I have updated the synchronization of revisions list.
Now this process is visible, automatic and fast.

This allows program to get started with latest revision selected by default.
In other words, to make latest revision running, you need just to start program and press <Enter>.

wildschwein
Posts: 413
Joined: Tue Sep 16, 2008 1:13 pm

Re: Software for automatization of regression tests

Post by wildschwein » Fri Nov 13, 2015 1:15 pm

How great ist that !!!

Perhaps you make a youtube video and demonstrate it, so that your software gets more famous under ROS Tester.
Just a suggestion...

Vort
Posts: 12
Joined: Wed Nov 09, 2011 7:37 pm
Location: Ukraine

Re: Software for automatization of regression tests

Post by Vort » Sun Nov 15, 2015 8:42 pm

Here is the video of 7-Zip installation with RosRegTest (~1 minute):
https://jira.reactos.org/secure/attachm ... egTest.mkv (6.6 MiB)

(used JIRA as hosting because I don't like YouTube)

Vort
Posts: 12
Joined: Wed Nov 09, 2011 7:37 pm
Location: Ukraine

Re: Software for automatization of regression tests

Post by Vort » Fri Nov 27, 2015 2:58 pm

Added some error messages:
* When required files not found;
* When download of zipped iso fails;
* When virtual machine is already running.

Also now downloaded .7z file gets deleted after .iso file is successfully extracted.

Vort
Posts: 12
Joined: Wed Nov 09, 2011 7:37 pm
Location: Ukraine

Re: Software for automatization of regression tests

Post by Vort » Tue Sep 27, 2016 3:48 pm

* Moved to HTTPS requests
* Packed all resources into single executable
Now binary release is available at GitHub:
https://github.com/Vort/RosRegTest/rele ... _0_0_1.zip

Post Reply

Who is online

Users browsing this forum: No registered users and 15 guests