FAQ
General
- Have seen UI automated testing failed in many projects, How TestWise be any different?
- I don't have programming skills, Can I develop automated tests using TestWise?
- Is the test framework reliable?
- Why TestWise is at such low price comparing to other commercial tools (around $5K-$10K range ore more)? Are there any catches?
- Why TestWise is not open-source? Our project manager wants use free, open-source only.
- We developed test scripts in TestWise IDE. Can our support team run/maintain these scripts without purchasing TestWise Licenses?
- Does TestWise IDE run on Mac OS X and Linux platforms?
- Does TestWise support performance or stress testing, like HP's LoadRunner?
- Can I use TestWise to test native windows applications?
- Can I integrate RWebSpec tests with continuous build servers?
- Does TestWise support Selenium?
- Can TestWise run Cucumber tests?
Licensing
- How does floating license work?
- What are differences between floating and named licenses?
- Can we use same license at different machines or locations?
- Is there any annual fees?
- Do you offer upgrade?
- What kind of software support does your company provide? Do you provide software testing consulting?
- What are limitations/restrictions for Community Edition?
- Why not completely free?
Technical
- Does TestWise IDE has some kind of recording tool to record test scripts?
- How to run tests outside TestWise IDE?
- Can I use Watir syntax in TestWise?
- We already have existing set of Watir tests, and want to use TestWise IDE, What should we do?
- TestWise didn't launch after installation.
Have seen UI automated testing failed in many projects, How TestWise be any different?
The observation is correct and we respect people who have the courage to express that out (many projects just buy expensive a testing tool, record a few tests, and tick 'Automated Testing' checkbox, period):
- UI Test Automation Tools are Snake by Michael Feather" (2010-01-04)
- "Automated testing through the GUI is intuitive, seductive, and almost always wrong!" by Uncle Bob, 2009-09-30
TestWise is different, we don't have sales pitch like "buy our tool it is simple as 'record-n-playback'". GUI automated testing is known easy to break, TestWise provides various support for maintain and develop test scripts in an easy and efficient way. Automated testing gets hard if no commitment and collaboration from the whole team, but the benefits are great, far greater than the effort.
"It is scary to think of software development without TestWise after using it" - user feedback
| Frustrations with other Testing Tools | TestWise |
|---|---|
| Complex and hard to learn | Learn in minutes, check out ScreenCasts |
| Complex, vendor propriate test scripts | Easy-to-read, open-source and free test framework |
| UI Automated Test Scripts are hard to mainain | Refactoring support using Page Objects |
| Expensive | Personal use: Free, Commercial Use: $449 |
| Restrictive: one syntax | Freedom of choose combination of Selenium2, Watir, RWebSpec with RSpec and Cucumber |
I don't have programming skills, Can I develop automated tests using TestWise?
Certainly. As matter of fact, this tool is built with non-programmers in mind!
We don't believe output from 'record-n-playback' tools are proper test scripts for real world, certainly without testers' refinement. If testers don't have full understanding of test scripts (commonly in proprietary syntax), how can they make changes? (Is there anybody still believing the fairy tale of 'requirement never changes ...')
Developing test scripts in TestWise might look like programming, but it is much simpler and easier than many (without programming) thought, how about this one?
click_link('Login')
enter_text('username', 'bob')
enter_password('password', 'thetester')
click_button('Login')
page_text.should include('Welcome Bob')
The best place to start is trying some sample tests under samples\ folder, then create your own project and using TestWise Recorder to create your first test. You will be surprised how easy it is!
Is the test framework reliable?
Yes. The test framework used in TestWise is RWebSpec, is an extension of popular Watir. You can check out Watir Testimonials. Watir's growing popularity can be approved from its clones: WatiN in Mircosoft .NET platform and Watij in Java Platform.
To quantify test framework's reliability, here we quote the test expert Lisa Crispin (author of 'Agile Testing') "We have a number of Watir suites, plus one big giant suite that includes all the others, the giant one takes maybe 3 hours to run." (here).
Here is a Comparison of Watir with Silk Test (conducted in 2005 by Tuyet Cong-Ton-Nu)
Why TestWise is at such low price comparing to other commercial tools (around $5K-$10K range ore more)? Are there any catches?
We believe automated testing shall be accessible to majority (if not all) team members. We have seen TestWise among mostly used software in teams embracing automated testing. Developers use it for verifying their own work; Customers, Team Leaders, Business Analysts and testers all have use of it. Here we give you an example usage: a team leader runs a test suite before going to a presentation confidently. More importantly, you will see power of team co-operation.
There is absolutely NO catches. All the tools (except IDE) are open source and free, and tests created by TestWise IDE can be executed from command line, and may be edited by other IDE or text editors.
The $449/$1249 price is not a mistake!
Why TestWise is not open-source? Our project manager wants use free, open-source only.
Firstly, 'Open-Source' is not equal to 'Free'. Richcard Stallman, founder of GNU, says: "When we call software 'free', we mean that it respects the users' essential freedoms". TestWise gives your maximum freedom, it’s test framework, recorder and runtime are all free and open-source. You can run tests without TestWise IDE. Making tool itself open-source has no benefits to users, just like we want PDF format to be an open standard, but don’t really care how Adobe Acrobat Reader is made.
In fact, offering software completely free (price) is not necessarily good for customers. How often have you seen developers abandoning free, open-source projects? (You probably won't do your job free for long either.) Instead, our approach is sustainable: affordable testing tools that gives users maximum freedom with support.
We developed test scripts in TestWise IDE. Can our support team run/maintain these scripts without purchasing TestWise Licenses??
spec -fs your_spec.rb
Does TestWise IDE run on Mac OS X and Linux platforms?
An early release of Mac version is available for download, here is a screenshot of TestWise IDE on Mac.
Does TestWise support performance or stress testing, like HP's LoadRunner?
Can I use TestWise to test native windows applications?
- Download and install AutoIT3, using its "AutoIt Window Info" tool to identify controls. Sorry, no recording tool here.
- Open project C:\Program Files\TestWise\samples\form_calculator\calculator.tpr, run it you shall see the ruby test scripts driving Windows' calculator.
Can I integrate RWebSpec tests with continuous build servers?
Does TestWise support Selenium?
Can TestWise run Cucumber tests?
What are differences between floating and named licenses?
Can we use same license at different machines or locations?
Is there any annual fees?
Do you offer upgrade?
What kind of software support does your company provide? Do you provide software testing consulting?
All licensed users are access to unlimited E-mail support, Free. Customers can also select supporting services suit their needs.
TestWise Product Support- Priority support and feature requests
- Create the TestWise project with a working test case
- Setting up Continuous Build Server with acceptance tests, and even Lava Lamp
- Test Script Reviews
What are limitations or restrictions of Commmunity Edition?
TestWise Commmunity Edition has adequate features (including refactoring) to help create, edit, run test scripts. Team features such as version control, environment selection and reporting are excluded. Selenium and Cucumber support are also excluded.
Community Edition is limited to personal or non-comercial use. The conditions for commercial use:
- Only one person can use TestWise Community Edition in a project team, i.e, only you.
- No other functional testing tools (including TestWise Professional Edition) being used in your project.
Why not completely free?
TestWise leads the testing tools in terms of being open and affordable. The test framework (RWebSpec), runtime (RubyShell) and recorder are all free.
We don't think free software actually serves customer's best interests, especially GUI software (paying graphic design, dealing with various UI issues, and donation of free frameworks ...). Over the years, we have seen many free, open-source projects being abandoned (for obvious reasons). This could mean loss of your investment of effort and time. Being a paid customer, you will not only have assurance of long-standing products, but also know you can get support (note: AgileWay's support will surprise you with joy).
Have a read of this intriguing blog post: 'Which tool would you pick...' from Venkat (Author of 'Practices of Agile Developer')
Does TestWise IDE has some kind of recording tool to record test scripts?
TestWise 2 includes a recorder for IE (early release).
How to run tests outside TestWise IDE?
spec your_spec.rb
Can I use Watir syntax in TestWise?
click_link("first: using RWebSpec syntax") # RWebSpec syntax
link(:text, "second: using Watir syntax").click # Watir syntax
We already have existing set of Watir tests, and want to use TestWise IDE, What should we do?
If you want to switch to RWebSpec (and introducing page objects for maintainability), it may be easier than you think. Running Watir tests against Firefox with TestWiseRecorder enabled, you will get executable RWebSpec test steps. It might also be a good time do some refactorings.
After installing TestWise IDE, it doesn't launch.
It may be configuration issues of your machine prevent TestWise starting up properly, to find out:
Start Command window (Click 'Start' -> 'Run', type in 'cmd').
cd c:\Program Files\TestWise testwise-console.bat
If you can't figure out from the error message displayed, please send it to support@agileway.com.au